Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve cluster setup reliability #3444

Merged
merged 5 commits into from
Aug 17, 2022

Conversation

Anviking
Copy link
Member

@Anviking Anviking commented Aug 16, 2022

  • Ensure only a single pool has started when we submit txs containing important cluster setup
    • Avoids setup being rolled back, later causing integration test failures
  • See that it works

Comments

Issue Number

ADP-2140

Moves responsibility away from the caller and to `withCluster` which
knows how to best setup mir, ma, and pure ada funds.

Sharing the default "all faucet funds from Test.Integration.Faucet" in
one place would be nice, but is tricky to do with the current package
splits.
- Add helper `extraClusterSetupUsingNode`
- Ensure it's called in both Alonzo and Babbage
- Move "pre-registered stake key" setup to said helper
@Anviking Anviking self-assigned this Aug 16, 2022
@Anviking
Copy link
Member Author

bors try

iohk-bors bot added a commit that referenced this pull request Aug 16, 2022
@iohk-bors
Copy link
Contributor

iohk-bors bot commented Aug 16, 2022

try

Build failed:

  To rerun use: --match "/CLI Specifications/COMMON_CLI_NETWORK/CLI_NETWORK - cardano-wallet network information/"

  src/Test/Integration/Scenario/CLI/Network.hs:63:5: 
  921) CLI Specifications, COMMON_CLI_NETWORK, NETWORK_PARAMS - network parameters
       uncaught exception: ProcessHasExited
       ProcessHasExited "cardano-cli failed: Command failed: transaction submit  Error: Error while submitting tx: ShelleyTxValidationError ShelleyBasedEraAlonzo (ApplyTxError [DelegsFailure (DelplFailure (PoolFailure (StakePoolNotRegisteredOnKeyPOOL (KeyHash \"1b3dc19c6ab89eaffc8501f375bb03c11bf8ed5d183736b1d80413d6\"))))])\n" (ExitFailure 1)

  To rerun use: --match "/CLI Specifications/COMMON_CLI_NETWORK/NETWORK_PARAMS - network parameters/"

  src/Test/Integration/Scenario/CLI/Network.hs:67:5: 
  922) CLI Specifications, COMMON_CLI_NETWORK, CLI_NETWORK - network clock
       uncaught exception: ProcessHasExited
       ProcessHasExited "cardano-cli failed: Command failed: transaction submit  Error: Error while submitting tx: ShelleyTxValidationError ShelleyBasedEraAlonzo (ApplyTxError [DelegsFailure (DelplFailure (PoolFailure (StakePoolNotRegisteredOnKeyPOOL (KeyHash \"1b3dc19c6ab89eaffc8501f375bb03c11bf8ed5d183736b1d80413d6\"))))])\n" (ExitFailure 1)

  To rerun use: --match "/CLI Specifications/COMMON_CLI_NETWORK/CLI_NETWORK - network clock/"

@Anviking
Copy link
Member Author

bors try

iohk-bors bot added a commit that referenced this pull request Aug 16, 2022
@iohk-bors
Copy link
Contributor

iohk-bors bot commented Aug 16, 2022

try

Build succeeded:

Copy link
Contributor

@paweljakubas paweljakubas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks like a significant bolstering of reliability!

@Anviking Anviking marked this pull request as ready for review August 17, 2022 07:55
@Anviking
Copy link
Member Author

bors r+

iohk-bors bot added a commit that referenced this pull request Aug 17, 2022
3444: Improve cluster setup reliability r=Anviking a=Anviking

- [x] Ensure only a single pool has started when we submit txs containing important cluster setup
    - Avoids setup being rolled back, later causing integration test failures
- [x] See that it works 

### Comments

<!-- Additional comments, links, or screenshots to attach, if any. -->

### Issue Number

<!-- Reference the Jira/GitHub issue that this PR relates to, and which requirements it tackles.
  Note: Jira issues of the form ADP- will be auto-linked. -->

ADP-2140


Co-authored-by: Johannes Lund <[email protected]>
@Anviking
Copy link
Member Author

Hm... seems no wallets are syncing and it's about to fail:

[cardano-wallet.wallet-engine:Warning:4090] [2022-08-17 09:18:39.47 UTC] 6a992466: Syncing (0.00% percent) Applied 0 blocks, 1 rollbacks in the last 5.036729959s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.pools-engine:Warning:1920] [2022-08-17 09:18:50.67 UTC] Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.00116796s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.wallet-engine:Warning:3926] [2022-08-17 09:19:00.56 UTC] 3f7398f0: Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.000918521s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.wallet-engine:Warning:3964] [2022-08-17 09:19:00.83 UTC] ec945775: Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.001310453s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.wallet-engine:Warning:3980] [2022-08-17 09:19:00.93 UTC] c9f1e715: Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.001245905s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.wallet-engine:Warning:4012] [2022-08-17 09:19:01.29 UTC] becfdbcf: Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.001101671s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.wallet-engine:Warning:4090] [2022-08-17 09:19:09.47 UTC] 6a992466: Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.000925088s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.pools-engine:Warning:1920] [2022-08-17 09:19:20.67 UTC] Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.000269838s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.wallet-engine:Warning:3926] [2022-08-17 09:19:30.56 UTC] 3f7398f0: Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.001067764s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.wallet-engine:Warning:3964] [2022-08-17 09:19:30.83 UTC] ec945775: Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.00074845s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.wallet-engine:Warning:3980] [2022-08-17 09:19:30.93 UTC] c9f1e715: Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.000425095s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.wallet-engine:Warning:4012] [2022-08-17 09:19:31.29 UTC] becfdbcf: Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.000254132s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.wallet-engine:Warning:4090] [2022-08-17 09:19:39.47 UTC] 6a992466: Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.000785648s. Current tip is [point genesis]. (not applying blocks)
[cardano-wallet.pools-engine:Warning:1920] [2022-08-17 09:19:50.67 UTC] Syncing (0.00% percent) Applied 0 blocks, 0 rollbacks in the last 30.001219428s. Current tip is [point genesis]. (not applying blocks)
retry: Test failed again in the same way.

I have seen this occasionally locally too in the past.

I think it doesn't have anything to do with this PR, but I also don't understand the cause 🤔

@Anviking
Copy link
Member Author

bors r-

@iohk-bors
Copy link
Contributor

iohk-bors bot commented Aug 17, 2022

Canceled.

@Anviking
Copy link
Member Author

bors r+

iohk-bors bot added a commit that referenced this pull request Aug 17, 2022
3437: Bump version numbers for release of v2022-08-16 r=HeinrichApfelmus a=HeinrichApfelmus

- [x] Bump dependencies to match `cardano-node` 1.35.3
- [x] Bump dependency on `cardano-addresses`.
- [x] Bump `cardano-wallet` version number to `2022.8.16`.

### Comments

In preparation for a release, this pull request bumps dependencies and the package  version number.

### Issue Number

ADP-1999

3444: Improve cluster setup reliability r=Anviking a=Anviking

- [x] Ensure only a single pool has started when we submit txs containing important cluster setup
    - Avoids setup being rolled back, later causing integration test failures
- [x] See that it works 

### Comments

<!-- Additional comments, links, or screenshots to attach, if any. -->

### Issue Number

<!-- Reference the Jira/GitHub issue that this PR relates to, and which requirements it tackles.
  Note: Jira issues of the form ADP- will be auto-linked. -->

ADP-2140


Co-authored-by: Heinrich Apfelmus <[email protected]>
Co-authored-by: Johannes Lund <[email protected]>
@iohk-bors
Copy link
Contributor

iohk-bors bot commented Aug 17, 2022

This PR was included in a batch that successfully built, but then failed to merge into master. It will not be retried.

Additional information:

{"message":"Required status check \"docs\" is expected.","documentation_url":"https://docs.github.com/articles/about-protected-branches"}

@Anviking
Copy link
Member Author

Merging manually

@Anviking Anviking merged commit 63def57 into master Aug 17, 2022
@Anviking Anviking deleted the anviking/ADP-2140/better-faucet-setup branch August 17, 2022 11:59
iohk-bors bot added a commit that referenced this pull request Aug 18, 2022
3446: Ensure withCluster can work with a single pool to fix latency bench r=Anviking a=Anviking

- [x] Ensure `launchPools []` doesn't fail with `Prelude.head: empty list`
    - With #3444, we launch the `head` of the pools separately from `launchPools (tail pools)`, so the tail can be empty.

### Comments

- [x] Nightly latency step should succeed https://buildkite.com/input-output-hk/cardano-wallet-nightly/builds/1465

<!-- Additional comments, links, or screenshots to attach, if any. -->

### Issue Number

ADP-2147



Co-authored-by: Johannes Lund <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants