Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add --markdown-output and unclassified failures count to scripts/bors-stats.rb #3127

Merged
merged 2 commits into from
Feb 11, 2022

Conversation

Anviking
Copy link
Member

  • Count unclassified failures in scripts/bors-stats.rb
  • Add --markdown-output option to scripts/bors-stats.rb

Comments

$ ./scripts/bors-stats.rb --markdown-output --after "1 Jan" --annotate "Timed out."
[...]
10 Feb 13:21 hydra https://github.com/input-output-hk/cardano-wallet/pull/3110#issuecomment-1034915493
https://hydra.iohk.io/build/12719899
Build failed:

ci/hydra-build:required

succeeded: 15 failed: 51 (77%) total: 66
Excluding 22 #expected or #duplicate failures
Unclassified: 8 (16% of all failures)

Broken down by tags/issues:
25 times (38%) hydra
19 times (29%) buildkite
9 times (14%) [#3120](https://github.com/input-output-hk/cardano-wallet/issues/3120) Flaky test: Various arcane `stack` problems in buildkite (pantry, libffi, ...)
6 times (9%) [#3057](https://github.com/input-output-hk/cardano-wallet/issues/3057) Flaky test: `StakeKeyAlreadyRegisteredDELEG` from `Plutus scenarios, withdrawal`
5 times (8%) [#3124](https://github.com/input-output-hk/cardano-wallet/issues/3124) Flaky test: ValidationFailedV1 NotEnoughSpace from `Plutus scenarios, currency`
5 times (8%) [#3123](https://github.com/input-output-hk/cardano-wallet/issues/3123) Flaky test: Lots of integration tests errors due to cluster or setup
5 times (8%) Timed out.
4 times (6%) [#3121](https://github.com/input-output-hk/cardano-wallet/issues/3121) Flaky test: `gai_strerror not supported: 11002` from `API Server, handles bad host name`
3 times (5%) [#3122](https://github.com/input-output-hk/cardano-wallet/issues/3122) Flaky test: `Plutus scenarios`, `missing_witnesses_in_transaction`
3 times (5%) [#2472](https://github.com/input-output-hk/cardano-wallet/issues/2472) Unit tests sometimes time out.
3 times (5%) [#2855](https://github.com/input-output-hk/cardano-wallet/issues/2855) Flaky test: Various CLI tests failing due to high load

Issue Number

None.

@Anviking Anviking changed the title Tweak scripts/bors-stats.rb: --markdown-output and unclassified failures count Add --markdown-output and unclassified failures count to scripts/bors-stats.rb Feb 10, 2022
@Anviking Anviking requested a review from rvl February 10, 2022 15:30
@Anviking Anviking self-assigned this Feb 10, 2022
Copy link
Contributor

@rvl rvl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice

@rvl rvl merged commit bf27d43 into master Feb 11, 2022
@rvl rvl deleted the anviking/improve-bors-stats branch February 11, 2022 06:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants