Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(analysis): Fix Analysis Terminal Decision For Dry-Run Metrics #2399

Merged
merged 1 commit into from
Nov 8, 2022

Conversation

agrawroh
Copy link
Member

@agrawroh agrawroh commented Nov 4, 2022

Description

We recently came across a bug in the Analysis Run with both the Dry as well as Wet metrics where the terminal decision was being made based on the metric ordering and since we are simply returning in case of a Dry-Run metric failure, it was shadowing the Wet-Run failures by not correctly terminating the Analysis Run.

The fix is to simply continue the loop and keep looking for any Wet-Run metric failures by ignoring the failures from Dry-Run metrics inside IsTerminating(...).

Checklist

  • Either (a) I've created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this is a chore.
  • The title of the PR is (a) conventional, (b) states what changed, and (c) suffixes the related issues number. E.g. "fix(controller): Updates such and such. Fixes #1234".
  • I've signed my commits with DCO
  • I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged.
  • My builds are green. Try syncing with master if they are not.
  • My organization is added to USERS.md.

@sonarcloud
Copy link

sonarcloud bot commented Nov 4, 2022

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
8.4% 8.4% Duplication

@github-actions
Copy link
Contributor

github-actions bot commented Nov 4, 2022

Go Published Test Results

1 778 tests   1 778 ✔️  2m 30s ⏱️
   101 suites         0 💤
       1 files           0

Results for commit 2df2f35.

@codecov
Copy link

codecov bot commented Nov 4, 2022

Codecov Report

Base: 82.76% // Head: 82.76% // Increases project coverage by +0.00% 🎉

Coverage data is based on head (2df2f35) compared to base (5db47e7).
Patch coverage: 100.00% of modified lines in pull request are covered.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #2399   +/-   ##
=======================================
  Coverage   82.76%   82.76%           
=======================================
  Files         121      121           
  Lines       18537    18539    +2     
=======================================
+ Hits        15342    15344    +2     
  Misses       2410     2410           
  Partials      785      785           
Impacted Files Coverage Δ
utils/analysis/helpers.go 79.27% <100.00%> (+0.10%) ⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@github-actions
Copy link
Contributor

github-actions bot commented Nov 4, 2022

E2E Tests Published Test Results

    2 files      2 suites   1h 33m 42s ⏱️
  89 tests   84 ✔️ 3 💤 2
180 runs  172 ✔️ 6 💤 2

For more details on these failures, see this check.

Results for commit 2df2f35.

@zachaller zachaller merged commit 93c2520 into argoproj:master Nov 8, 2022
jandersen-plaid pushed a commit to jandersen-plaid/argo-rollouts that referenced this pull request Nov 8, 2022
jandersen-plaid pushed a commit to jandersen-plaid/argo-rollouts that referenced this pull request Nov 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants