Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[mergify] make framework upgrade test land-blocking #6757

Merged
merged 1 commit into from
Feb 24, 2023

Conversation

rustielin
Copy link
Contributor

@rustielin rustielin commented Feb 23, 2023

Description

Make the new forge framework upgrade test land-blocking. The test has been running since #6638 landed, but has not been land-blocking

Test Plan

Tests on this PR. Test takes roughly the same amount of time as the rest

image

@rustielin rustielin requested a review from a team as a code owner February 23, 2023 23:39
@rustielin rustielin added the CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR label Feb 24, 2023
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions
Copy link
Contributor

✅ Forge suite framework_upgrade success on cb4ba0a57c998c60cbab65af31a64875d2588ca5 ==> 57219f7c9de4b433a7e95008d3001f039684ddeb

Compatibility test results for cb4ba0a57c998c60cbab65af31a64875d2588ca5 ==> 57219f7c9de4b433a7e95008d3001f039684ddeb (PR)
Upgrade the nodes to version: 57219f7c9de4b433a7e95008d3001f039684ddeb
framework_upgrade::framework-upgrade::full-framework-upgrade : 7004 TPS, 5521 ms latency, 9400 ms p99 latency,no expired txns
5. check swarm health
Compatibility test for cb4ba0a57c998c60cbab65af31a64875d2588ca5 ==> 57219f7c9de4b433a7e95008d3001f039684ddeb passed
Test Ok

@github-actions
Copy link
Contributor

✅ Forge suite compat success on testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 57219f7c9de4b433a7e95008d3001f039684ddeb

Compatibility test results for testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 57219f7c9de4b433a7e95008d3001f039684ddeb (PR)
1. Check liveness of validators at old version: testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b
compatibility::simple-validator-upgrade::liveness-check : 6602 TPS, 6743 ms latency, 46200 ms p99 latency,no expired txns
2. Upgrading first Validator to new version: 57219f7c9de4b433a7e95008d3001f039684ddeb
compatibility::simple-validator-upgrade::single-validator-upgrade : 4795 TPS, 8119 ms latency, 12100 ms p99 latency,no expired txns
3. Upgrading rest of first batch to new version: 57219f7c9de4b433a7e95008d3001f039684ddeb
compatibility::simple-validator-upgrade::half-validator-upgrade : 4906 TPS, 8441 ms latency, 11800 ms p99 latency,no expired txns
4. upgrading second batch to new version: 57219f7c9de4b433a7e95008d3001f039684ddeb
compatibility::simple-validator-upgrade::rest-validator-upgrade : 7108 TPS, 5645 ms latency, 10900 ms p99 latency,no expired txns
5. check swarm health
Compatibility test for testnet_2d8b1b57553d869190f61df1aaf7f31a8fc19a7b ==> 57219f7c9de4b433a7e95008d3001f039684ddeb passed
Test Ok

@github-actions
Copy link
Contributor

✅ Forge suite land_blocking success on 57219f7c9de4b433a7e95008d3001f039684ddeb

performance benchmark with full nodes : 5766 TPS, 6876 ms latency, 14700 ms p99 latency,(!) expired 380 out of 2462540 txns
Test Ok

@rustielin rustielin merged commit 42d2697 into main Feb 24, 2023
@rustielin rustielin deleted the rustielin/forge-framework-lbt branch February 24, 2023 04:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants