-
Notifications
You must be signed in to change notification settings - Fork 217
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
STAKE_POOLS_GARBAGE_COLLECTION_01 timed out #2337
Comments
2338: Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending r=jonathanknowles a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending r=jonathanknowles a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending r=jonathanknowles a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
Interestingly, in #2338 (comment), the STAKE_POOLS_GARBAGE_COLLECTION_01 test was marked pending, but there was still a similar-looking timeout. This would suggest that STAKE_POOLS_GARBAGE_COLLECTION_01 itself is never the cause for the timeout. Another peculiarity is that our custom |
In the wallet logs from #2338 (comment), we see that the final hour is spent making no other requests but
|
Some more messier notes:
*) gistered on chain... Please wait 60s until active... Can be skipped using NO_POOLS=1.
[cardano-wallet.integration:Notice:416] [2020-11-24 15:55:23.85 UTC] http://127.0.0.1:62818/
### Setup
### List pools
### Join pools
### Waiting...
### Eventually gets rewards...
[cardano-wallet.network:Error:453] [2020-11-24 15:58:05.21 UTC] Error when querying local state parameters for TipSyncClient: AcquireFailurePointNotOnChain
[cardano-wallet.network:Error:453] [2020-11-24 15:58:05.21 UTC] Error when querying local state parameters for TipSyncClient: AcquireFailurePointNotOnChain
[cardano-wallet.network:Error:453] [2020-11-24 15:58:05.22 UTC] Error when querying local state parameters for TipSyncClient: AcquireFailurePointNotOnChain
[cardano-wallet.network:Error:422] [2020-11-24 15:58:11.21 UTC] Error when querying local state parameters for DelegationRewardsClient: AcquireFailurePointNotOnChain
[cardano-wallet.network:Error:453] [2020-11-24 15:58:11.22 UTC] Error when querying local state parameters for TipSyncClient: AcquireFailurePointNotOnChain
[cardano-wallet.network:Error:453] [2020-11-24 15:58:11.22 UTC] Error when querying local state parameters for TipSyncClient: AcquireFailurePointNotOnChain
[cardano-wallet.network:Error:453] [2020-11-24 15:58:11.22 UTC] Error when querying local state parameters for TipSyncClient: AcquireFailurePointNotOnChain |
2338: Mark TRANS_TTL_{01,02}, STAKE_POOLS_JOIN_05, and STAKE_POOLS_SMASH_01 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Also mark STAKE_POOLS_SMASH_01 pending - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02}, STAKE_POOLS_JOIN_05, and STAKE_POOLS_SMASH_01 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Also mark STAKE_POOLS_SMASH_01 pending - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> 2346: get rid of 'OnDanglingChange' option for fee balancing r=KtorZ a=KtorZ # Issue Number <!-- Put here a reference to the issue this PR relates to and which requirements it tackles --> ADP-568 # Overview <!-- Detail in a few bullet points the work accomplished in this PR --> - [ ] I have removed 'OnDanglingChange' option for fee balancing. # Comments <!-- Additional comments or screenshots to attach if any --> This option allowed choosing between two modes: SaveMoney and PayAndBalance. The former was used with cardano-node, and the latter used with jormungandr. The reason for having a difference is was because of discrepency in the minimum transaction expected by both ledger. On jormungandr, transactions have to be _exactly_ balanced and leave exactly the expected fees required by the network. On the counterpart, the fee calculation was only a function of the number of inputs and outputs... therefore much easier to satisfy than on cardano-node. Now that we've removed jormungandr, this extra indirection / complexity is just harmful. Since the 'PayAndBalance' mode is never used, I've removed the option entirely and made code assume 'SaveMoney' everywhere it used to choose between both alternatives. This also seemingly remove the 'allowUnbalancedTx' field from the transaction layer which was directly related to this option. <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]> Co-authored-by: KtorZ <[email protected]>
2338: Mark TRANS_TTL_{01,02}, STAKE_POOLS_JOIN_05, and STAKE_POOLS_SMASH_01 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Also mark STAKE_POOLS_SMASH_01 pending - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
2338: Mark TRANS_TTL_{01,02}, STAKE_POOLS_JOIN_05, and STAKE_POOLS_SMASH_01 pending r=Anviking a=Anviking # Issue Number None. Addressing CI failures. # Overview - [x] Add new `flakyBecauseOf ticketOrReason` helper that calls `pendingWith` unless `RUN_FLAKY_TESTS` is set. - [x] Mark TRANS_TTL_{01,02} and STAKE_POOLS_JOIN_05 pending/flaky. - [x] Also mark STAKE_POOLS_SMASH_01 pending - [x] Add manual test calling for running flaky tests # Comments - Should lower the failure rate by 21% of runs, from 59% to 38%. - Next candidate for marking pending would be #2224, but with a relatively low failure rate of 3.6%, and being important, I think it would be a bad idea. - Maybe we should have flaky tests run per default, unless setting `DONT_RUN_FLAKY_TESTS` in CI, to maximise the times we run them locally. Recent bors failures: ``` succeded: 19, failed: 37 (66%), total: 56 excluding #expected failures Broken down by tags/issues: 10 times #2292 Flaky test - various DB properties causing timeout | #2292 7 times #2295 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 6 times 3 times #2311 Flaky test - integration test timeout after/related to STAKE_POOLS_LIST_01 | #2311 3 times #2230 Flaky STAKE_POOLS_JOIN_05 - Can join when stake key already exists | #2230 2 times #2224 Flaky STAKE_POOLS_LIST_01 - List stake pools, has non-zero saturation & stake | #2224 1 times #another-integration-timeout | 1 times #2337 STAKE_POOLS_GARBAGE_COLLECTION_01 timed out | #2337 1 times #2320 Flaky test - The node backend is unreachable at the moment. STAKE_POOLS_QUIT_02 | #2320 1 times #2295, #2331 Flaky TRANS_TTL_{01,02} - SlotNo 80 > SlotNo 50 | #2295 1 times #2207 Flaky SHELLEY_MIGRATE_01_big_wallet | #2207 1 times #2118 Property `prop_rebalanceSelection` occasionally fails. | #2118 ``` <!-- Additional comments or screenshots to attach if any --> <!-- Don't forget to: ✓ Self-review your changes to make sure nothing unexpected slipped through ✓ Assign yourself to the PR ✓ Assign one or several reviewer(s) ✓ Once created, link this PR to its corresponding ticket ✓ Assign the PR to a corresponding milestone ✓ Acknowledge any changes required to the Wiki --> Co-authored-by: Johannes Lund <[email protected]>
Context
Test Case
STAKE_POOLS_GARBAGE_COLLECTION_01
Failure / Counter-example
Test timed out during the first stage of the pool garbage collection integration test.
This could be because previous stages took too long to complete, or it could be because this stage itself timed out. Further investigation is required.
Resolution
QA
The text was updated successfully, but these errors were encountered: