Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nimbus t8n(evm) speed report #2356

Open
winsvega opened this issue Jun 14, 2024 · 5 comments
Open

nimbus t8n(evm) speed report #2356

winsvega opened this issue Jun 14, 2024 · 5 comments

Comments

@winsvega
Copy link

winsvega commented Jun 14, 2024

the most timeconsuming tests in nimbus t8n vs geth t8n (Cancun only)
(most of this tests has high amount of transactions)

NIMBUS
*** Execution time stats
Total Time:                               : 2453.19         :   38.02 (1%)              : 2418.66 (98%)
stTimeConsuming                       time: 674.20   cputime:    8.47 (1%)       t8ntime:  666.59 (98%)
stBadOpcode                           time: 426.38   cputime:    6.79 (1%)       t8ntime:  420.27 (98%)
stEIP1559                             time: 182.41   cputime:    3.99 (2%)       t8ntime:  178.72 (97%)
vmPerformance                         time: 166.92   cputime:    0.03 (0%)       t8ntime:  166.90 (99%)
stPreCompiledContracts                time: 98.67    cputime:    1.40 (1%)       t8ntime:   97.41 (98%)
stZeroKnowledge                       time: 95.12    cputime:    1.53 (1%)       t8ntime:   93.74 (98%)
stMemoryTest                          time: 56.24    cputime:    0.88 (1%)       t8ntime:   55.44 (98%)
stStaticCall                          time: 55.58    cputime:    0.85 (1%)       t8ntime:   54.81 (98%)
eip4844_blobs                         time: 53.98    cputime:    1.02 (1%)       t8ntime:   53.05 (98%)
stZeroKnowledge2                      time: 51.22    cputime:    0.97 (1%)       t8ntime:   50.33 (98%)
stEIP150singleCodeGasPrices           time: 45.41    cputime:    0.63 (1%)       t8ntime:   44.86 (98%)
stSStoreTest                          time: 43.74    cputime:    0.58 (1%)       t8ntime:   43.23 (98%)
stStackTests                          time: 41.46    cputime:    1.38 (3%)       t8ntime:   40.15 (96%)
stRandom                              time: 32.51    cputime:    0.80 (2%)       t8ntime:   31.78 (97%)

GETH
*** Execution time stats
Total Time:                               : 1118.55         :   36.63 (3%)              : 1084.98 (96%)
stTimeConsuming                       time: 298.80   cputime:    8.12 (2%)       t8ntime:  291.40 (97%)
stBadOpcode                           time: 189.22   cputime:    6.51 (3%)       t8ntime:  183.30 (96%)
stEIP1559                             time: 81.92    cputime:    3.91 (4%)       t8ntime:   78.29 (95%)
vmPerformance                         time: 58.25    cputime:    0.03 (0%)       t8ntime:   58.23 (99%)
stZeroKnowledge                       time: 43.15    cputime:    1.49 (3%)       t8ntime:   41.80 (96%)
stPreCompiledContracts                time: 41.32    cputime:    1.31 (3%)       t8ntime:   40.15 (97%)
eip4844_blobs                         time: 39.76    cputime:    0.99 (2%)       t8ntime:   38.86 (97%)
stMemoryTest                          time: 25.12    cputime:    0.85 (3%)       t8ntime:   24.35 (96%)
@jangko
Copy link
Contributor

jangko commented Jun 14, 2024

loading kzg trusted setup maybe?

@arnetheduck
Copy link
Member

@winsvega I'd be curious to see the results of the latest master of nimbus today on the same machine, if you still have access

@winsvega
Copy link
Author

winsvega commented Aug 19, 2024

The nimbus t8n broke on aug 17.
Do you still support --state.reward=-1 ?

Here are the stats for Cancun only state tests:

http://retesteth.ethdevops.io/results/log//2024-08-19-1724047927-nimbus.txt

@arnetheduck
Copy link
Member

Should be fixed now, the tracer config accidentally broke

@winsvega
Copy link
Author

Today's stats. Keep in mind that it also fluctuates from run to run.

NIMBUS
*** Execution time stats
Total Time:                               : 2312.56         :   38.78 (1%)              : 2277.28 (98%)
stTimeConsuming                       time: 644.08   cputime:    8.61 (1%)       t8ntime:  636.30 (98%)
stBadOpcode                           time: 414.28   cputime:    6.97 (1%)       t8ntime:  408.01 (98%)
stEIP1559                             time: 175.61   cputime:    4.05 (2%)       t8ntime:  171.87 (97%)
vmPerformance                         time: 108.96   cputime:    0.04 (0%)       t8ntime:  108.93 (99%)
stZeroKnowledge                       time: 90.72    cputime:    1.58 (1%)       t8ntime:   89.29 (98%)
stPreCompiledContracts                time: 89.80    cputime:    1.35 (1%)       t8ntime:   88.59 (98%)
stStaticCall                          time: 55.68    cputime:    0.91 (1%)       t8ntime:   54.85 (98%)
stMemoryTest                          time: 54.61    cputime:    0.90 (1%)       t8ntime:   53.80 (98%)
eip4844_blobs                         time: 53.64    cputime:    1.06 (1%)       t8ntime:   52.67 (98%)
stZeroKnowledge2                      time: 48.65    cputime:    0.95 (1%)       t8ntime:   47.78 (98%)
stSStoreTest                          time: 45.23    cputime:    0.65 (1%)       t8ntime:   44.65 (98%)
stEIP150singleCodeGasPrices           time: 41.55    cputime:    0.60 (1%)       t8ntime:   41.02 (98%)
stStackTests                          time: 38.86    cputime:    1.38 (3%)       t8ntime:   37.55 (96%)
stRandom                              time: 34.15    cputime:    0.82 (2%)       t8ntime:   33.39 (97%

GETH
*** Execution time stats
Total Time:                               : 1157.52         :   37.87 (3%)              : 1122.83 (97%)
stTimeConsuming                       time: 310.45   cputime:    8.46 (2%)       t8ntime:  302.76 (97%)
stBadOpcode                           time: 197.76   cputime:    6.76 (3%)       t8ntime:  191.63 (96%)
stEIP1559                             time: 84.13    cputime:    4.01 (4%)       t8ntime:   80.38 (95%)
vmPerformance                         time: 59.78    cputime:    0.03 (0%)       t8ntime:   59.75 (99%)
stZeroKnowledge                       time: 43.12    cputime:    1.52 (3%)       t8ntime:   41.73 (96%)
stPreCompiledContracts                time: 42.71    cputime:    1.32 (3%)       t8ntime:   41.52 (97%)
eip4844_blobs                         time: 40.29    cputime:    0.99 (2%)       t8ntime:   39.38 (97%)
stMemoryTest                          time: 25.64    cputime:    0.88 (3%)       t8ntime:   24.84 (96%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants