Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

recalibrate move e2e tests #15112

Merged
merged 1 commit into from
Oct 29, 2024
Merged

recalibrate move e2e tests #15112

merged 1 commit into from
Oct 29, 2024

Conversation

igor-aptos
Copy link
Contributor

Description

want to have clean baseline, for the changes coming on top (for move 2 compiler). I don't see any changes in last 90 days, so this is probably not perfectly calibrated to start with, or some very old perf change.

Copy link

trunk-io bot commented Oct 29, 2024

@igor-aptos igor-aptos added the CICD:run-execution-performance-test Run execution performance test label Oct 29, 2024
@igor-aptos igor-aptos enabled auto-merge (rebase) October 29, 2024 22:47

This comment has been minimized.

This comment has been minimized.

Copy link
Contributor

✅ Forge suite realistic_env_max_load success on 34db5e5f0d9f34a9e9775a886a1dee3b85cfdb02

two traffics test: inner traffic : committed: 14036.79 txn/s, latency: 2830.47 ms, (p50: 2700 ms, p70: 2700, p90: 3000 ms, p99: 3300 ms), latency samples: 5337100
two traffics test : committed: 100.02 txn/s, latency: 1482.68 ms, (p50: 1400 ms, p70: 1500, p90: 1600 ms, p99: 4900 ms), latency samples: 1860
Latency breakdown for phase 0: ["MempoolToBlockCreation: max: 2.087, avg: 1.622", "ConsensusProposalToOrdered: max: 0.335, avg: 0.300", "ConsensusOrderedToCommit: max: 0.369, avg: 0.354", "ConsensusProposalToCommit: max: 0.665, avg: 0.654"]
Max non-epoch-change gap was: 0 rounds at version 0 (avg 0.00) [limit 4], 0.91s no progress at version 2415295 (avg 0.21s) [limit 15].
Max epoch-change gap was: 0 rounds at version 0 (avg 0.00) [limit 4], 8.40s no progress at version 2415293 (avg 8.40s) [limit 15].
Test Ok

Copy link
Contributor

✅ Forge suite compat success on 9c922ebe94f5ff4b58df4617f3ff003e2ce10ccd ==> 34db5e5f0d9f34a9e9775a886a1dee3b85cfdb02

Compatibility test results for 9c922ebe94f5ff4b58df4617f3ff003e2ce10ccd ==> 34db5e5f0d9f34a9e9775a886a1dee3b85cfdb02 (PR)
1. Check liveness of validators at old version: 9c922ebe94f5ff4b58df4617f3ff003e2ce10ccd
compatibility::simple-validator-upgrade::liveness-check : committed: 17298.88 txn/s, latency: 1965.54 ms, (p50: 2100 ms, p70: 2100, p90: 2200 ms, p99: 2400 ms), latency samples: 556900
2. Upgrading first Validator to new version: 34db5e5f0d9f34a9e9775a886a1dee3b85cfdb02
compatibility::simple-validator-upgrade::single-validator-upgrading : committed: 5990.65 txn/s, latency: 4787.39 ms, (p50: 5400 ms, p70: 5800, p90: 6000 ms, p99: 6000 ms), latency samples: 110620
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 5985.65 txn/s, latency: 5413.96 ms, (p50: 6000 ms, p70: 6200, p90: 6700 ms, p99: 7300 ms), latency samples: 200400
3. Upgrading rest of first batch to new version: 34db5e5f0d9f34a9e9775a886a1dee3b85cfdb02
compatibility::simple-validator-upgrade::half-validator-upgrading : committed: 5896.29 txn/s, latency: 4878.52 ms, (p50: 5700 ms, p70: 5900, p90: 6000 ms, p99: 6200 ms), latency samples: 112180
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 6016.14 txn/s, latency: 5385.87 ms, (p50: 5900 ms, p70: 6100, p90: 6500 ms, p99: 7100 ms), latency samples: 205920
4. upgrading second batch to new version: 34db5e5f0d9f34a9e9775a886a1dee3b85cfdb02
compatibility::simple-validator-upgrade::rest-validator-upgrading : committed: 8981.14 txn/s, latency: 3186.70 ms, (p50: 3500 ms, p70: 3800, p90: 4000 ms, p99: 4200 ms), latency samples: 156400
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 9345.41 txn/s, latency: 3452.94 ms, (p50: 3600 ms, p70: 3800, p90: 4000 ms, p99: 4200 ms), latency samples: 304280
5. check swarm health
Compatibility test for 9c922ebe94f5ff4b58df4617f3ff003e2ce10ccd ==> 34db5e5f0d9f34a9e9775a886a1dee3b85cfdb02 passed
Test Ok

@igor-aptos igor-aptos merged commit f8f2741 into main Oct 29, 2024
127 of 142 checks passed
@igor-aptos igor-aptos deleted the igor/recalibrate_move_e2e branch October 29, 2024 23:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CICD:run-execution-performance-test Run execution performance test
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants