Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make StateComputeResult an combination of immutable stage outputs #15041

Merged
merged 7 commits into from
Oct 26, 2024

Conversation

msmouse
Copy link
Contributor

@msmouse msmouse commented Oct 22, 2024

Description

This is to make it easy to move data and logic between stages.

How Has This Been Tested?

existing coverage

Key Areas to Review

Type of Change

  • Refactoring

Which Components or Systems Does This Change Impact?

  • Validator Node

Copy link

trunk-io bot commented Oct 22, 2024

⏱️ 28h 59m total CI duration on this PR
Slowest 15 Jobs Cumulative Duration Recent Runs
execution-performance / single-node-performance 10h 2m 🟥🟩🟩🟥🟩 (+25 more)
single-node-performance 6h 17m 🟥🟥🟩🟩🟥 (+10 more)
execution-performance / test-target-determinator 2h 2m 🟩🟩🟩🟩🟩 (+23 more)
test-target-determinator 1h 24m 🟩🟩🟩🟩 (+17 more)
check 1h 11m 🟩🟩🟩🟩 (+17 more)
test-target-determinator 59m 🟩🟩🟩🟩🟩 (+10 more)
check-dynamic-deps 35m 🟩🟩🟩🟩🟩 (+18 more)
rust-cargo-deny 35m 🟩🟩🟩🟩 (+16 more)
fetch-last-released-docker-image-tag 33m 🟩🟩🟩🟩 (+17 more)
rust-smoke-tests 30m 🟥
rust-move-tests 10m 🟩
rust-move-tests 10m 🟩
rust-move-tests 10m 🟩
rust-move-tests 10m 🟩
rust-move-tests 10m 🟩

🚨 1 job on the last run was significantly faster/slower than expected

Job Duration vs 7d avg Delta
execution-performance / single-node-performance 34m 16m +114%

settingsfeedbackdocs ⋅ learn more about trunk.io

@msmouse msmouse added the CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR label Oct 22, 2024
Base automatically changed from 1018-alden-immutable-outputs to main October 22, 2024 00:57
@msmouse msmouse force-pushed the 1018-alden-immutable-outputs2 branch 4 times, most recently from 494ddec to e0b7fc4 Compare October 22, 2024 23:50
@msmouse msmouse changed the title Immutable execution stage outputs Makes StateComputeResult an combination of immutable stage outputs Oct 22, 2024

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@msmouse msmouse changed the title Makes StateComputeResult an combination of immutable stage outputs Make StateComputeResult an combination of immutable stage outputs Oct 23, 2024
@msmouse msmouse force-pushed the 1018-alden-immutable-outputs2 branch 2 times, most recently from 69bde1a to d906106 Compare October 23, 2024 20:43

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@msmouse msmouse force-pushed the 1018-alden-immutable-outputs2 branch from 4ff8b66 to e32fe4a Compare October 24, 2024 00:29

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@msmouse msmouse force-pushed the 1018-alden-immutable-outputs2 branch from fffc8ec to 3e96013 Compare October 24, 2024 07:05

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@msmouse msmouse marked this pull request as ready for review October 24, 2024 07:58

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@msmouse msmouse force-pushed the 1018-alden-immutable-outputs2 branch from 47a0dc4 to 957aa69 Compare October 26, 2024 00:54

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

@msmouse msmouse force-pushed the 1018-alden-immutable-outputs2 branch from 957aa69 to 51ad6e7 Compare October 26, 2024 16:56
@msmouse msmouse enabled auto-merge (rebase) October 26, 2024 16:56
@msmouse msmouse force-pushed the 1018-alden-immutable-outputs2 branch from 51ad6e7 to 8a33314 Compare October 26, 2024 17:01

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Copy link
Contributor

✅ Forge suite realistic_env_max_load success on 8a333147b518446ce5ea2b39417f0b0039a34869

two traffics test: inner traffic : committed: 14308.13 txn/s, latency: 2777.50 ms, (p50: 2700 ms, p70: 2700, p90: 3000 ms, p99: 3300 ms), latency samples: 5440260
two traffics test : committed: 99.94 txn/s, latency: 1496.24 ms, (p50: 1400 ms, p70: 1400, p90: 1500 ms, p99: 7400 ms), latency samples: 1740
Latency breakdown for phase 0: ["MempoolToBlockCreation: max: 1.999, avg: 1.573", "ConsensusProposalToOrdered: max: 0.325, avg: 0.293", "ConsensusOrderedToCommit: max: 0.367, avg: 0.352", "ConsensusProposalToCommit: max: 0.658, avg: 0.645"]
Max non-epoch-change gap was: 0 rounds at version 0 (avg 0.00) [limit 4], 1.08s no progress at version 44817 (avg 0.20s) [limit 15].
Max epoch-change gap was: 0 rounds at version 0 (avg 0.00) [limit 4], 8.50s no progress at version 2486330 (avg 8.50s) [limit 15].
Test Ok

Copy link
Contributor

✅ Forge suite framework_upgrade success on f38ec72e975a4dff4e9919e7a1d8118a75858bab ==> 8a333147b518446ce5ea2b39417f0b0039a34869

Compatibility test results for f38ec72e975a4dff4e9919e7a1d8118a75858bab ==> 8a333147b518446ce5ea2b39417f0b0039a34869 (PR)
Upgrade the nodes to version: 8a333147b518446ce5ea2b39417f0b0039a34869
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1240.50 txn/s, submitted: 1244.04 txn/s, failed submission: 3.54 txn/s, expired: 3.54 txn/s, latency: 2400.25 ms, (p50: 2400 ms, p70: 2400, p90: 3600 ms, p99: 5400 ms), latency samples: 112040
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1267.45 txn/s, submitted: 1269.88 txn/s, failed submission: 2.42 txn/s, expired: 2.42 txn/s, latency: 2385.11 ms, (p50: 2400 ms, p70: 2600, p90: 3500 ms, p99: 4500 ms), latency samples: 115000
5. check swarm health
Compatibility test for f38ec72e975a4dff4e9919e7a1d8118a75858bab ==> 8a333147b518446ce5ea2b39417f0b0039a34869 passed
Upgrade the remaining nodes to version: 8a333147b518446ce5ea2b39417f0b0039a34869
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1409.15 txn/s, submitted: 1411.85 txn/s, failed submission: 2.71 txn/s, expired: 2.71 txn/s, latency: 2147.29 ms, (p50: 1800 ms, p70: 2100, p90: 3300 ms, p99: 5800 ms), latency samples: 124880
Test Ok

Copy link
Contributor

✅ Forge suite compat success on f38ec72e975a4dff4e9919e7a1d8118a75858bab ==> 8a333147b518446ce5ea2b39417f0b0039a34869

Compatibility test results for f38ec72e975a4dff4e9919e7a1d8118a75858bab ==> 8a333147b518446ce5ea2b39417f0b0039a34869 (PR)
1. Check liveness of validators at old version: f38ec72e975a4dff4e9919e7a1d8118a75858bab
compatibility::simple-validator-upgrade::liveness-check : committed: 14667.04 txn/s, latency: 2261.56 ms, (p50: 1900 ms, p70: 2100, p90: 2900 ms, p99: 8700 ms), latency samples: 559920
2. Upgrading first Validator to new version: 8a333147b518446ce5ea2b39417f0b0039a34869
compatibility::simple-validator-upgrade::single-validator-upgrading : committed: 6969.29 txn/s, latency: 4044.54 ms, (p50: 4400 ms, p70: 4800, p90: 5400 ms, p99: 5700 ms), latency samples: 131620
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 6980.65 txn/s, latency: 4629.61 ms, (p50: 4900 ms, p70: 5100, p90: 6300 ms, p99: 6700 ms), latency samples: 234360
3. Upgrading rest of first batch to new version: 8a333147b518446ce5ea2b39417f0b0039a34869
compatibility::simple-validator-upgrade::half-validator-upgrading : committed: 6745.56 txn/s, latency: 4249.88 ms, (p50: 4900 ms, p70: 5100, p90: 5200 ms, p99: 5400 ms), latency samples: 124800
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 6689.81 txn/s, latency: 4863.44 ms, (p50: 5300 ms, p70: 5400, p90: 6100 ms, p99: 6700 ms), latency samples: 224360
4. upgrading second batch to new version: 8a333147b518446ce5ea2b39417f0b0039a34869
compatibility::simple-validator-upgrade::rest-validator-upgrading : committed: 8760.76 txn/s, latency: 3271.67 ms, (p50: 3600 ms, p70: 3900, p90: 4100 ms, p99: 4400 ms), latency samples: 156000
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 7695.29 txn/s, latency: 3890.26 ms, (p50: 3900 ms, p70: 4100, p90: 4400 ms, p99: 5800 ms), latency samples: 284660
5. check swarm health
Compatibility test for f38ec72e975a4dff4e9919e7a1d8118a75858bab ==> 8a333147b518446ce5ea2b39417f0b0039a34869 passed
Test Ok

@msmouse msmouse merged commit 8bf147e into main Oct 26, 2024
48 checks passed
@msmouse msmouse deleted the 1018-alden-immutable-outputs2 branch October 26, 2024 17:43
@msmouse msmouse mentioned this pull request Oct 28, 2024
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CICD:run-e2e-tests when this label is present github actions will run all land-blocking e2e tests from the PR CICD:run-execution-performance-full-test Run execution performance test (full version) CICD:run-execution-performance-test Run execution performance test
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants