Skip to content
GitHub Actions / Published E2E Test Results succeeded Aug 7, 2024 in 0s

7 fail, 6 skipped, 98 pass in 3h 32m 29s

  4 files    4 suites   3h 32m 29s ⏱️
111 tests  98 ✅  6 💤  7 ❌
462 runs  420 ✅ 24 💤 18 ❌

Results for commit b7d5d53.

Annotations

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

2 out of 6 runs failed: TestAnalysisSuite/TestMultipleAnalysis (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.29)/junit-e2e-test.xml [took 1m 31s]
Raw output
Failed
=== RUN   TestAnalysisSuite/TestMultipleAnalysis
time="2024-08-07T10:09:26Z" level=info msg="Deleting e2e-test-name=TestMultipleAnalysis"
time="2024-08-07T10:09:27Z" level=info msg="analysistemplate.argoproj.io/template-a created\n" rollout=multi-analysis
time="2024-08-07T10:09:27Z" level=info msg="analysistemplate.argoproj.io/template-b created\n" rollout=multi-analysis
time="2024-08-07T10:09:27Z" level=info msg="rollout.argoproj.io/multi-analysis created\n" rollout=multi-analysis
time="2024-08-07T10:09:27Z" level=info msg="Waiting for condition: status=Healthy" rollout=multi-analysis
time="2024-08-07T10:09:28Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=multi-analysis
time="2024-08-07T10:09:28Z" level=info msg="AnalysisRun expectation 'analysisrun count == 0' met" rollout=multi-analysis
time="2024-08-07T10:09:28Z" level=info msg="Updated rollout pod spec: 2024-08-07T10:09:28.647835204Z" rollout=multi-analysis
time="2024-08-07T10:09:28Z" level=info msg="Waiting for condition: status=Healthy" rollout=multi-analysis
    when.go:455: timeout after 1m30s waiting for condition status=Healthy
Name:            multi-analysis
Namespace:       default
Status:          �[31m✖�[0m Degraded
Message:         RolloutAborted: Rollout aborted update to revision 2: Metric "metric-1" assessed Error due to consecutiveErrors (5) > consecutiveErrorLimit (4): "Error Message: received non 2xx response code: 403"
Strategy:        Canary
  Step:          0/1
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       0
  Ready:         1
  Available:     1

NAME                                        KIND         STATUS        AGE  INFO
⟳ multi-analysis                            Rollout      �[31m✖�[0m Degraded    91s  
├──# revision:2                                                             
│  ├──⧉ �[33mmulti-analysis-649bcd4d74�[0m           ReplicaSet   �[0m•�[0m ScaledDown  90s  �[33mcanary�[0m
│  └──α �[0mmulti-analysis-649bcd4d74-2-0�[0m       AnalysisRun  �[31m⚠�[0m Error       90s  �[31m⚠�[0m 20
└──# revision:1                                                             
   └──⧉ �[32mmulti-analysis-5d85f99875�[0m           ReplicaSet   �[32m✔�[0m Healthy     91s  �[32mstable�[0m
      └──□ multi-analysis-5d85f99875-q4bjm  Pod          �[32m✔�[0m Running     91s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2024-08-07T10:09:27Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestMultipleAnalysis
  name: multi-analysis
  namespace: default
  resourceVersion: "3074"
  uid: a67c692d-e0a2-40b4-bde8-aca36f6ec44a
spec:
  replicas: 1
  selector:
    matchLabels:
      app: multi-analysis
  strategy:
    canary:
      steps:
      - analysis:
          analysisRunMetadata: {}
          args:
          - name: host
            value: api.github.com
          - name: repo
            value: argoproj/argo-rollouts
          templates:
          - templateName: template-a
          - templateName: template-b
  template:
    metadata:
      annotations:
        update: "2024-08-07T10:09:28.647835204Z"
      creationTimestamp: null
      labels:
        app: multi-analysis
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: multi-analysis
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  abort: true
  abortedAt: "2024-08-07T10:10:08Z"
  availableReplicas: 1
  blueGreen: {}
  canary:
    currentStepAnalysisRunStatus:
      message: 'Metric "metric-1" assessed Error due to consecutiveErrors (5) > consecutiveErrorLimit
        (4): "Error Message: received non 2xx response code: 403"'
      name: multi-analysis-649bcd4d74-2-0
      status: Error
  conditions:
  - lastTransitionTime: "2024-08-07T10:09:28Z"
    lastUpdateTime: "2024-08-07T10:09:28Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2024-08-07T10:09:28Z"
    lastUpdateTime: "2024-08-07T10:09:28Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2024-08-07T10:09:28Z"
    lastUpdateTime: "2024-08-07T10:09:28Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2024-08-07T10:10:08Z"
    lastUpdateTime: "2024-08-07T10:10:08Z"
    message: 'Rollout aborted update to revision 2: Metric "metric-1" assessed Error
      due to consecutiveErrors (5) > consecutiveErrorLimit (4): "Error Message: received
      non 2xx response code: 403"'
    reason: RolloutAborted
    status: "False"
    type: Progressing
  currentPodHash: 649bcd4d74
  currentStepHash: 5c88946c99
  currentStepIndex: 0
  message: 'RolloutAborted: Rollout aborted update to revision 2: Metric "metric-1"
    assessed Error due to consecutiveErrors (5) > consecutiveErrorLimit (4): "Error
    Message: received non 2xx response code: 403"'
  observedGeneration: "3"
  phase: Degraded
  readyReplicas: 1
  replicas: 1
  selector: app=multi-analysis
  stableRS: 5d85f99875

2024-08-07T10:09:27Z    Normal     RolloutAddedToInformer    Rollout resource added to informer: default/multi-analysis
2024-08-07T10:09:27Z    Normal     RolloutNotCompleted       Rollout not completed, started update to revision 1 (5d85f99875)
2024-08-07T10:09:27Z    Normal     RolloutUpdated            Rollout updated to revision 1
2024-08-07T10:09:27Z    Normal     NewReplicaSetCreated      Created ReplicaSet multi-analysis-5d85f99875 (revision 1)
2024-08-07T10:09:27Z    Normal     ScalingReplicaSet         Scaled up ReplicaSet multi-analysis-5d85f99875 (revision 1) from 0 to 1
2024-08-07T10:09:27Z    Normal     RolloutCompleted          Rollout completed update to revision 1 (5d85f99875): Initial deploy
2024-08-07T10:09:28Z    Normal     RolloutNotCompleted       Rollout not completed, started update to revision 2 (649bcd4d74)
2024-08-07T10:09:28Z    Normal     RolloutUpdated            Rollout updated to revision 2
2024-08-07T10:09:28Z    Normal     NewReplicaSetCreated      Created ReplicaSet multi-analysis-649bcd4d74 (revision 2)
2024-08-07T10:09:28Z    Normal     AnalysisRunRunning        Step Analysis Run 'multi-analysis-649bcd4d74-2-0' Status New: 'Running' Previous: ''
2024-08-07T10:10:08Z    Warning    AnalysisRunError          Step Analysis Run 'multi-analysis-649bcd4d74-2-0' Status New: 'Error' Previous: 'Running'
2024-08-07T10:10:08Z    Warning    RolloutAborted            Rollout aborted update to revision 2: Metric "metric-1" assessed Error due to consecutiveErrors (5) > consecutiveErrorLimit (4): "Error Message: received non 2xx response code: 403"

time="2024-08-07T10:10:58Z" level=info msg="Deleting e2e-test-name=TestMultipleAnalysis"
time="2024-08-07T10:10:58Z" level=info msg="Deleting e2e-test-name"
    --- FAIL: TestAnalysisSuite/TestMultipleAnalysis (91.98s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

2 out of 6 runs failed: TestAnalysisSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.29)/junit-e2e-test.xml [took 1m 32s]
Raw output
Failed
=== RUN   TestAnalysisSuite
time="2024-08-07T10:05:29Z" level=info msg="analysistemplate.argoproj.io/web-background created\n"
time="2024-08-07T10:05:29Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
time="2024-08-07T10:05:29Z" level=info msg="analysistemplate.argoproj.io/multiple-job created\n"
time="2024-08-07T10:05:29Z" level=info msg="analysistemplate.argoproj.io/multiple-job-fail created\n"
--- FAIL: TestAnalysisSuite (329.27s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

1 out of 5 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeight (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.29)/junit-e2e-test.xml [took 12s]
Raw output
Failed
=== RUN   TestAWSSuite/TestALBExperimentStepNoSetWeight
time="2024-08-07T10:12:38Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
time="2024-08-07T10:12:38Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2024-08-07T10:12:38Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2024-08-07T10:12:38Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2024-08-07T10:12:38Z" level=info msg="Warning: annotation \"kubernetes.io/ingress.class\" is deprecated, please use 'spec.ingressClassName' instead\ningress.networking.k8s.io/alb-rollout-ingress created\n" rollout=alb-rollout
time="2024-08-07T10:12:38Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2024-08-07T10:12:38Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2024-08-07T10:12:39Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=alb-rollout
time="2024-08-07T10:12:40Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2024-08-07T10:12:40Z" level=info msg="Updated rollout pod spec: 2024-08-07T10:12:40.000554914Z" rollout=alb-rollout
time="2024-08-07T10:12:40Z" level=info msg="Sleeping 10s" rollout=alb-rollout
    require.go:72: 
        	Error Trace:	/home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:330
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:29
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:320
        	Error:      	Not equal: 
        	            	expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	actual  : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	            	+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	Test:       	TestAWSSuite/TestALBExperimentStepNoSetWeight
Name:            alb-rollout
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/1
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       0
  Ready:         1
  Available:     1

NAME                                                                 KIND        STATUS         AGE  INFO
⟳ alb-rollout                                                        Rollout     �[94m◌�[0m Progressing  12s  
├──# revision:2                                                                                      
│  ├──⧉ �[33malb-rollout-5b679b7dc�[0m                                        ReplicaSet  �[0m•�[0m ScaledDown   10s  �[33mcanary�[0m
│  └──Σ �[94malb-rollout-5b679b7dc-2-0�[0m                                    Experiment  �[94m◌�[0m Running      10s  
│     ├──⧉ alb-rollout-5b679b7dc-2-0-experiment-alb-canary           ReplicaSet  �[32m✔�[0m Healthy      10s  
│     │  └──□ alb-rollout-5b679b7dc-2-0-experiment-alb-canary-znnvw  Pod         �[32m✔�[0m Running      10s  ready:1/1
│     └──⧉ alb-rollout-5b679b7dc-2-0-experiment-alb-stable           ReplicaSet  �[32m✔�[0m Healthy      10s  
│        └──□ alb-rollout-5b679b7dc-2-0-experiment-alb-stable-xm7vx  Pod         �[32m✔�[0m Running      10s  ready:1/1
└──# revision:1                                                                                      
   └──⧉ �[32malb-rollout-d6f4fdcdc�[0m                                        ReplicaSet  �[32m✔�[0m Healthy      12s  �[32mstable�[0m
      └──□ alb-rollout-d6f4fdcdc-lkflc                               Pod         �[32m✔�[0m Running      12s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2024-08-07T10:12:38Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestALBExperimentStepNoSetWeight
  name: alb-rollout
  namespace: default
  resourceVersion: "4105"
  uid: 101a1a89-4ad9-4cd9-abf8-16db298831af
spec:
  replicas: 1
  selector:
    matchLabels:
      app: alb-rollout
  strategy:
    canary:
      canaryService: alb-rollout-canary
      stableService: alb-rollout-stable
      steps:
      - experiment:
          analysisRunMetadata: {}
          duration: 15s
          templates:
          - metadata: {}
            name: experiment-alb-canary
            specRef: canary
            weight: 20
          - metadata: {}
            name: experiment-alb-stable
            specRef: stable
            weight: 20
      trafficRouting:
        alb:
          ingress: alb-rollout-ingress
          rootService: alb-rollout-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2024-08-07T10:12:40.000554914Z"
      creationTimestamp: null
      labels:
        app: alb-rollout
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: alb-rollout
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  availableReplicas: 1
  blueGreen: {}
  canary:
    currentExperiment: alb-rollout-5b679b7dc-2-0
    weights:
      additional:
      - weight: 20
      - weight: 20
      canary:
        podTemplateHash: 5b679b7dc
        serviceName: alb-rollout-canary
        weight: 0
      stable:
        podTemplateHash: d6f4fdcdc
        serviceName: alb-rollout-stable
        weight: 60
  conditions:
  - lastTransitionTime: "2024-08-07T10:12:39Z"
    lastUpdateTime: "2024-08-07T10:12:39Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2024-08-07T10:12:40Z"
    lastUpdateTime: "2024-08-07T10:12:40Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2024-08-07T10:12:40Z"
    lastUpdateTime: "2024-08-07T10:12:40Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2024-08-07T10:12:38Z"
    lastUpdateTime: "2024-08-07T10:12:40Z"
    message: Created new replica set "alb-rollout-5b679b7dc"
    reason: NewReplicaSetCreated
    status: "True"
    type: Progressing
  currentPodHash: 5b679b7dc
  currentStepHash: 8b59978
  currentStepIndex: 0
  message: more replicas need to be updated
  observedGeneration: "3"
  phase: Progressing
  readyReplicas: 1
  replicas: 1
  selector: app=alb-rollout
  stableRS: d6f4fdcdc

2024-08-07T10:12:38Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/alb-rollout
2024-08-07T10:12:38Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (d6f4fdcdc)
2024-08-07T10:12:38Z         Normal    RolloutUpdated            Rollout updated to revision 1
2024-08-07T10:12:38Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2024-08-07T10:12:41Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-ingress` to desiredWeight '0'
2024-08-07T10:12:38Z         Normal    TrafficWeightUpdated      Traffic weight updated to 0
2024-08-07T10:12:38Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2024-08-07T10:12:38Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2024-08-07T10:12:40Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated 
2024-08-07T10:12:39Z         Normal    SwitchService             Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2024-08-07T10:12:39Z         Normal    SwitchService             Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2024-08-07T10:12:40Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (5b679b7dc)
2024-08-07T10:12:40Z         Normal    RolloutUpdated            Rollout updated to revision 2
2024-08-07T10:12:40Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-5b679b7dc (revision 2)
2024-08-07T10:12:40Z         Normal    ExperimentCreated         Created Experiment 'alb-rollout-5b679b7dc-2-0'
2024-08-07T10:12:41Z         Normal    TrafficWeightUpdated      Traffic weight updated additional: [{20  } {20  }]

time="2024-08-07T10:12:50Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
    --- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeight (12.16s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

6 out of 10 runs failed: TestAWSSuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.26)/junit-e2e-test.xml [took 2m 11s]
artifacts/E2E Test Results (k8s 1.28)/junit-e2e-test.xml [took 12s]
artifacts/E2E Test Results (k8s 1.29)/junit-e2e-test.xml [took 1m 51s]
Raw output
Failed
=== RUN   TestAWSSuite
--- FAIL: TestAWSSuite (111.43s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

5 out of 9 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.26)/junit-e2e-test.xml [took 13s]
artifacts/E2E Test Results (k8s 1.28)/junit-e2e-test.xml [took 12s]
Raw output
Failed
=== RUN   TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
time="2024-08-07T10:12:05Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeightMultiIngress"
time="2024-08-07T10:12:05Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2024-08-07T10:12:05Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2024-08-07T10:12:05Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2024-08-07T10:12:05Z" level=info msg="ingress.networking.k8s.io/alb-rollout-multi-ingress-1 created\n" rollout=alb-rollout
time="2024-08-07T10:12:05Z" level=info msg="ingress.networking.k8s.io/alb-rollout-multi-ingress-2 created\n" rollout=alb-rollout
time="2024-08-07T10:12:05Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2024-08-07T10:12:05Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2024-08-07T10:12:08Z" level=info msg="Condition 'status=Healthy' met after 2s" rollout=alb-rollout
time="2024-08-07T10:12:08Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2024-08-07T10:12:08Z" level=info msg="Updated rollout pod spec: 2024-08-07T10:12:08.1679928Z" rollout=alb-rollout
time="2024-08-07T10:12:08Z" level=info msg="Sleeping 10s" rollout=alb-rollout
    require.go:72: 
        	Error Trace:	/home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:365
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:29
        	            				/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:354
        	Error:      	Not equal: 
        	            	expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	actual  : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	            	+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
        	Test:       	TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
Name:            alb-rollout
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         more replicas need to be updated
Strategy:        Canary
  Step:          0/1
  SetWeight:     0
  ActualWeight:  0
Images:          nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
  Desired:       1
  Current:       1
  Updated:       0
  Ready:         1
  Available:     1

NAME                                                                  KIND        STATUS         AGE  INFO
⟳ alb-rollout                                                         Rollout     �[94m◌�[0m Progressing  13s  
├──# revision:2                                                                                       
│  ├──⧉ �[33malb-rollout-669b56669f�[0m                                        ReplicaSet  �[0m•�[0m ScaledDown   10s  �[33mcanary�[0m
│  └──Σ �[94malb-rollout-669b56669f-2-0�[0m                                    Experiment  �[94m◌�[0m Running      10s  
│     ├──⧉ alb-rollout-669b56669f-2-0-experiment-alb-canary           ReplicaSet  �[32m✔�[0m Healthy      10s  
│     │  └──□ alb-rollout-669b56669f-2-0-experiment-alb-canary-zb96l  Pod         �[32m✔�[0m Running      10s  ready:1/1
│     └──⧉ alb-rollout-669b56669f-2-0-experiment-alb-stable           ReplicaSet  �[32m✔�[0m Healthy      10s  
│        └──□ alb-rollout-669b56669f-2-0-experiment-alb-stable-lk5kz  Pod         �[32m✔�[0m Running      10s  ready:1/1
└──# revision:1                                                                                       
   └──⧉ �[32malb-rollout-d6f4fdcdc�[0m                                         ReplicaSet  �[32m✔�[0m Healthy      13s  �[32mstable�[0m
      └──□ alb-rollout-d6f4fdcdc-hvj6j                                Pod         �[32m✔�[0m Running      13s  ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2024-08-07T10:12:05Z"
  generation: 3
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestALBExperimentStepNoSetWeightMultiIngress
  name: alb-rollout
  namespace: default
  resourceVersion: "4376"
  uid: a7af723b-69cd-4c35-be35-5317d68afea0
spec:
  replicas: 1
  selector:
    matchLabels:
      app: alb-rollout
  strategy:
    canary:
      canaryService: alb-rollout-canary
      stableService: alb-rollout-stable
      steps:
      - experiment:
          analysisRunMetadata: {}
          duration: 15s
          templates:
          - metadata: {}
            name: experiment-alb-canary
            specRef: canary
            weight: 20
          - metadata: {}
            name: experiment-alb-stable
            specRef: stable
            weight: 20
      trafficRouting:
        alb:
          ingresses:
          - alb-rollout-multi-ingress-1
          - alb-rollout-multi-ingress-2
          rootService: alb-rollout-root
          servicePort: 80
  template:
    metadata:
      annotations:
        update: "2024-08-07T10:12:08.1679928Z"
      creationTimestamp: null
      labels:
        app: alb-rollout
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: alb-rollout
        ports:
        - containerPort: 80
          name: http
          protocol: TCP
        resources:
          requests:
            cpu: 5m
            memory: 16Mi
status:
  HPAReplicas: 1
  availableReplicas: 1
  blueGreen: {}
  canary:
    currentExperiment: alb-rollout-669b56669f-2-0
    weights:
      additional:
      - weight: 20
      - weight: 20
      canary:
        podTemplateHash: 669b56669f
        serviceName: alb-rollout-canary
        weight: 0
      stable:
        podTemplateHash: d6f4fdcdc
        serviceName: alb-rollout-stable
        weight: 60
  conditions:
  - lastTransitionTime: "2024-08-07T10:12:08Z"
    lastUpdateTime: "2024-08-07T10:12:08Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2024-08-07T10:12:08Z"
    lastUpdateTime: "2024-08-07T10:12:08Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2024-08-07T10:12:08Z"
    lastUpdateTime: "2024-08-07T10:12:08Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "False"
    type: Completed
  - lastTransitionTime: "2024-08-07T10:12:05Z"
    lastUpdateTime: "2024-08-07T10:12:08Z"
    message: Created new replica set "alb-rollout-669b56669f"
    reason: NewReplicaSetCreated
    status: "True"
    type: Progressing
  currentPodHash: 669b56669f
  currentStepHash: 8b59978
  currentStepIndex: 0
  message: more replicas need to be updated
  observedGeneration: "3"
  phase: Progressing
  readyReplicas: 1
  replicas: 1
  selector: app=alb-rollout
  stableRS: d6f4fdcdc

2024-08-07T10:12:05Z         Normal    RolloutAddedToInformer    Rollout resource added to informer: default/alb-rollout
2024-08-07T10:12:05Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (d6f4fdcdc)
2024-08-07T10:12:05Z         Normal    RolloutUpdated            Rollout updated to revision 1
2024-08-07T10:12:05Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2024-08-07T10:12:05Z         Normal    TrafficWeightUpdated      Traffic weight updated to 0
2024-08-07T10:12:05Z         Normal    ScalingReplicaSet         Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2024-08-07T10:12:05Z         Normal    RolloutCompleted          Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2024-08-07T10:12:08Z         Normal    SwitchService             Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2024-08-07T10:12:08Z         Normal    SwitchService             Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2024-08-07T10:12:08Z         Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (669b56669f)
2024-08-07T10:12:08Z         Normal    RolloutUpdated            Rollout updated to revision 2
2024-08-07T10:12:08Z         Normal    NewReplicaSetCreated      Created ReplicaSet alb-rollout-669b56669f (revision 2)
2024-08-07T10:12:08Z (x2)    Normal    TrafficWeightUpdated      Traffic weight updated 
2024-08-07T10:12:08Z         Normal    ExperimentCreated         Created Experiment 'alb-rollout-669b56669f-2-0'
2024-08-07T10:12:10Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-multi-ingress-1` to desiredWeight '0'
2024-08-07T10:12:10Z (x2)    Normal    PatchingALBIngress        Updating Ingress `alb-rollout-multi-ingress-2` to desiredWeight '0'
2024-08-07T10:12:10Z         Normal    TrafficWeightUpdated      Traffic weight updated additional: [{20  } {20  }]

time="2024-08-07T10:12:18Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeightMultiIngress"
    --- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (13.48s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

1 out of 5 runs failed: TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.28)/junit-e2e-test.xml [took 4s]
Raw output
Failed
=== RUN   TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
time="2024-08-07T10:19:59Z" level=info msg="Deleting e2e-test-name=TestRolloutWithMaxSurgeScalingDuringUpdate"
time="2024-08-07T10:19:59Z" level=info msg="rollout.argoproj.io/updatescaling created\n" rollout=updatescaling
time="2024-08-07T10:19:59Z" level=info msg="Waiting for condition: status=Healthy" rollout=updatescaling
time="2024-08-07T10:20:00Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=updatescaling
W0807 10:20:00.891860   26935 warnings.go:70] unknown field "spec.template.metadata.creationTimestamp"
time="2024-08-07T10:20:00Z" level=info msg="Patched rollout: {\"spec\":{\"template\":{\"spec\":{\"containers\":[{\"name\":\"updatescaling\",\"resources\":{\"requests\":{\"cpu\":\"2m\",\"memory\":\"16Mi\"}}}]}}}}" rollout=updatescaling
time="2024-08-07T10:20:00Z" level=info msg="Waiting for condition: status.replicas=7" rollout=updatescaling
time="2024-08-07T10:20:01Z" level=info msg="Condition 'status.replicas=7' met after 0s" rollout=updatescaling
time="2024-08-07T10:20:01Z" level=info msg="Pod expectation 'canary pod count == 4' met" rollout=updatescaling
time="2024-08-07T10:20:01Z" level=info msg="Pod expectation 'stable pod count == 3' met" rollout=updatescaling
time="2024-08-07T10:20:01Z" level=info msg="Scaled rollout to 8" rollout=updatescaling
time="2024-08-07T10:20:01Z" level=info msg="Waiting for condition: status.replicas=11" rollout=updatescaling
time="2024-08-07T10:20:01Z" level=info msg="Condition 'status.replicas=11' met after 0s" rollout=updatescaling
time="2024-08-07T10:20:01Z" level=info msg="Pod expectation 'canary pod count == 8' met" rollout=updatescaling
time="2024-08-07T10:20:01Z" level=info msg="Pod expectation 'stable pod count == 3' met" rollout=updatescaling
time="2024-08-07T10:20:01Z" level=info msg="Scaled rollout to 4" rollout=updatescaling
time="2024-08-07T10:20:01Z" level=info msg="Waiting for condition: status.replicas=7" rollout=updatescaling
time="2024-08-07T10:20:02Z" level=info msg="Condition 'status.replicas=7' met after 1s" rollout=updatescaling
time="2024-08-07T10:20:02Z" level=info msg="Pod expectation 'canary pod count == 4' met" rollout=updatescaling
time="2024-08-07T10:20:02Z" level=warning msg="unexpected stable (hash 79b6b5f5d4) pod count: expected 3, saw: 4" rollout=updatescaling
time="2024-08-07T10:20:02Z" level=error msg="Pod expectation 'stable pod count == 3' failed" rollout=updatescaling
Name:            updatescaling
Namespace:       default
Status:          �[94m◌�[0m Progressing
Message:         old replicas are pending termination
Strategy:        Canary
  Step:          
  SetWeight:     100
  ActualWeight:  100
Images:          nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
  Desired:       4
  Current:       7
  Updated:       4
  Ready:         7
  Available:     7

NAME                                       KIND        STATUS         AGE  INFO
⟳ updatescaling                            Rollout     �[94m◌�[0m Progressing  4s   
├──# revision:2                                                            
│  └──⧉ �[32mupdatescaling-79b6b5f5d4�[0m           ReplicaSet  �[32m✔�[0m Healthy      3s   �[32mstable�[0m
│     ├──□ updatescaling-79b6b5f5d4-2cjz8  Pod         �[32m✔�[0m Running      3s   ready:1/1
│     ├──□ updatescaling-79b6b5f5d4-89lv2  Pod         �[32m✔�[0m Running      3s   ready:1/1
│     ├──□ updatescaling-79b6b5f5d4-p4kkf  Pod         �[32m✔�[0m Running      3s   ready:1/1
│     ├──□ updatescaling-79b6b5f5d4-zz96t  Pod         �[32m✔�[0m Running      3s   ready:1/1
│     ├──□ updatescaling-79b6b5f5d4-b9r4b  Pod         �[94m◌�[0m Terminating  2s   ready:1/1
│     ├──□ updatescaling-79b6b5f5d4-gh5kn  Pod         �[94m◌�[0m Terminating  2s   ready:1/1
│     ├──□ updatescaling-79b6b5f5d4-m7krt  Pod         �[94m◌�[0m Terminating  2s   ready:1/1
│     └──□ updatescaling-79b6b5f5d4-nl8xn  Pod         �[94m◌�[0m Terminating  2s   ready:1/1
└──# revision:1                                                            
   └──⧉ updatescaling-54d546d75c           ReplicaSet  �[94m◌�[0m Progressing  4s   
      └──□ updatescaling-54d546d75c-ffz98  Pod         �[94m◌�[0m Terminating  4s   ready:1/1

---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
  annotations:
    rollout.argoproj.io/revision: "2"
  creationTimestamp: "2024-08-07T10:19:59Z"
  generation: 4
  labels:
    argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
    e2e-test-name: TestRolloutWithMaxSurgeScalingDuringUpdate
  name: updatescaling
  namespace: default
  resourceVersion: "10296"
  uid: a74f662d-9722-4cee-9f6f-901001af8bf0
spec:
  replicas: 4
  selector:
    matchLabels:
      app: updatescaling
  strategy:
    canary:
      maxSurge: 100%
  template:
    metadata:
      creationTimestamp: null
      labels:
        app: updatescaling
    spec:
      containers:
      - image: nginx:1.19-alpine
        name: updatescaling
        resources:
          requests:
            cpu: 2m
            memory: 16Mi
status:
  HPAReplicas: 7
  availableReplicas: 7
  blueGreen: {}
  canary: {}
  conditions:
  - lastTransitionTime: "2024-08-07T10:20:00Z"
    lastUpdateTime: "2024-08-07T10:20:00Z"
    message: Rollout is not healthy
    reason: RolloutHealthy
    status: "False"
    type: Healthy
  - lastTransitionTime: "2024-08-07T10:20:01Z"
    lastUpdateTime: "2024-08-07T10:20:01Z"
    message: Rollout has minimum availability
    reason: AvailableReason
    status: "True"
    type: Available
  - lastTransitionTime: "2024-08-07T10:20:02Z"
    lastUpdateTime: "2024-08-07T10:20:02Z"
    message: RolloutCompleted
    reason: RolloutCompleted
    status: "True"
    type: Completed
  - lastTransitionTime: "2024-08-07T10:19:59Z"
    lastUpdateTime: "2024-08-07T10:20:02Z"
    message: ReplicaSet "updatescaling-79b6b5f5d4" is progressing.
    reason: ReplicaSetUpdated
    status: "True"
    type: Progressing
  currentPodHash: 79b6b5f5d4
  currentStepHash: 5ffbfbbd64
  message: old replicas are pending termination
  observedGeneration: "4"
  phase: Progressing
  readyReplicas: 7
  replicas: 7
  selector: app=updatescaling
  stableRS: 79b6b5f5d4
  updatedReplicas: 4

2024-08-07T10:19:59Z    Normal    RolloutAddedToInformer    Rollout resource added to informer: default/updatescaling
2024-08-07T10:19:59Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 1 (54d546d75c)
2024-08-07T10:19:59Z    Normal    RolloutUpdated            Rollout updated to revision 1
2024-08-07T10:19:59Z    Normal    NewReplicaSetCreated      Created ReplicaSet updatescaling-54d546d75c (revision 1)
2024-08-07T10:19:59Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet updatescaling-54d546d75c (revision 1) from 0 to 4
2024-08-07T10:19:59Z    Normal    RolloutCompleted          Rollout completed update to revision 1 (54d546d75c): Initial deploy
2024-08-07T10:20:00Z    Normal    RolloutNotCompleted       Rollout not completed, started update to revision 2 (79b6b5f5d4)
2024-08-07T10:20:00Z    Normal    RolloutUpdated            Rollout updated to revision 2
2024-08-07T10:20:00Z    Normal    NewReplicaSetCreated      Created ReplicaSet updatescaling-79b6b5f5d4 (revision 2)
2024-08-07T10:20:00Z    Normal    ScalingReplicaSet         Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 4 to 3
2024-08-07T10:20:00Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 0 to 4
2024-08-07T10:20:01Z    Normal    ScalingReplicaSet         Scaled up ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 4 to 8
2024-08-07T10:20:01Z    Normal    ScalingReplicaSet         Scaled down ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 8 to 4
2024-08-07T10:20:01Z    Normal    ScalingReplicaSet         Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 3 to 1
2024-08-07T10:20:02Z    Normal    ScalingReplicaSet         Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 1 to 0
2024-08-07T10:20:02Z    Normal    RolloutCompleted          Rollout completed update to revision 2 (79b6b5f5d4): Completed all 0 canary steps

time="2024-08-07T10:20:03Z" level=info msg="Deleting e2e-test-name=TestRolloutWithMaxSurgeScalingDuringUpdate"
time="2024-08-07T10:20:03Z" level=info msg="Waiting for 1 rollouts to delete"
time="2024-08-07T10:20:03Z" level=info msg="Deleting e2e-test-name"
    --- FAIL: TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate (4.24s)

Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

1 out of 5 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)

artifacts/E2E Test Results (k8s 1.28)/junit-e2e-test.xml [took 5m 22s]
Raw output
Failed
=== RUN   TestCanarySuite
time="2024-08-07T10:14:41Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (322.35s)

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

6 skipped tests found

There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Published E2E Test Results

111 tests found

There are 111 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBMesh_PingPong_StableCanary_Update
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRouteMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelayWithProgressDeadline
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryWithPausedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestNeverScaleDown
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownOnSuccess
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownProgressively
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitInStableDownscaleAfterCanaryAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite