Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ProjectTracking]: Stateless Validation benchmarking #10543

Closed
5 of 7 tasks
Tracked by #20
staffik opened this issue Feb 1, 2024 · 0 comments
Closed
5 of 7 tasks
Tracked by #20

[ProjectTracking]: Stateless Validation benchmarking #10543

staffik opened this issue Feb 1, 2024 · 0 comments
Assignees
Labels

Comments

@staffik
Copy link
Contributor

staffik commented Feb 1, 2024

Context

Stateless Validation tracking issue.

Goal

Stateless Validation should be benchmarked and analyzed in a presentable format.

Motivation

  • Performance optimization and stability enhancement should be in place based on incoming data.
  • Bowen Wang plans to share findings from Stateless validation StatelessNet during EthDenver (Feb 29th).
  • We need enough confidence on resilience, scalability, reliability of the network before completing StatelessNet (March 31st).

Tasks

  • Prepare and share a plan for benchmarking. Zulip
  • Run locust scenario against StatelessNet, possibly finding issues. Zulip
  • Run locust scenario against adversenet, comparing current Mainnet binary with StatelessNet binary.
  • (ideally due February 15th) In-memory trie is ready.
  • Run the locust scenarios again with in-memory trie enabled (against StatelessNet and adversenet).
  • (due February 21st) Compare data for 3 binary versions: current Mainnet, Stateless Validation with / without in-memory trie and write up a report for EthDenver.
  • (February 29th) EthDenver
  • (March 15th) Check-in, discuss if we have enough confidence in the network.
  • (March 31st) Wrap up the StatelessNet test and share the final report.

Prerequisites (ideally due February 15th)

@staffik staffik self-assigned this Feb 1, 2024
@staffik staffik added A-stateless-validation Area: stateless validation project-tracking labels Feb 1, 2024
@staffik staffik changed the title [ProjectTracking]: StatelessNet data collection [ProjectTracking]: Stateless Validation data collection Feb 6, 2024
@staffik staffik changed the title [ProjectTracking]: Stateless Validation data collection [ProjectTracking]: Stateless Validation benchmarking Feb 6, 2024
@staffik staffik closed this as completed Jul 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant