feat: Benchmark protogalaxy prover

[codygunton]

Benchmark Protogalaxy prover. This just benchmarks the current folding function. Future PRs will make update and augment with values that will better reflect performance in production.

Results: uses 16 cores (for the x86 build). fold_one/N measures the time to call the fold_instances (which currently includes computation of selector commitments) function to fold a single instance into an accumulator where the instance sizes are $2^N$. Note this is for the Ultra arithmetization (so no Goblin, Poseidon2 or DataBus relations).

% taskset -c 0-15 ./bin/protogalaxy_bench                   38s ~/barretenberg-cpp/build cg/pg-bench mainframe
2024-01-11T19:39:49+00:00
Running ./bin/protogalaxy_bench
Run on (128 X 2649.99 MHz CPU s)
CPU Caches:
  L1 Data 32 KiB (x64)
  L1 Instruction 32 KiB (x64)
  L2 Unified 512 KiB (x64)
  L3 Unified 32768 KiB (x8)
Load Average: 3.48, 8.51, 27.24
------------------------------------------------------
Benchmark            Time             CPU   Iterations
------------------------------------------------------
fold_one/14        417 ms          259 ms            3
fold_one/15        668 ms          409 ms            2
fold_one/16       1158 ms          696 ms            1
fold_one/17       2245 ms         1433 ms            1
fold_one/18       4168 ms         2644 ms            1
fold_one/19       7890 ms         5119 ms            1
fold_one/20      15809 ms        10633 ms            1

Closes AztecProtocol/barretenberg#692

[AztecBot]

Benchmark results

No metrics with a significant change found.

Detailed results

All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.

This benchmark source data is available in JSON format on S3 here.

Values are compared against data from master at commit 7002a332 and shown if the difference exceeds 1%.

L2 block published to L1

Each column represents the number of txs on an L2 block published to L1.

Metric	8 txs	32 txs	128 txs
l1_rollup_calldata_size_in_bytes	45,444	179,588	716,132
l1_rollup_calldata_gas	221,028	865,916	3,447,632
l1_rollup_execution_gas	934,172	3,968,390	24,791,168
l2_block_processing_time_in_ms	1,345	5,207 (+1%)	21,449 (+1%)
note_successful_decrypting_time_in_ms	313 (+2%)	958	3,509 (+2%)
note_trial_decrypting_time_in_ms	25.0 (+22%)	88.7 (+7%)	143 (+5%)
l2_block_building_time_in_ms	15,113 (+2%)	59,568 (+1%)	239,854 (+1%)
l2_block_rollup_simulation_time_in_ms	10,596 (+1%)	42,077 (+1%)	170,226 (+1%)
l2_block_public_tx_process_time_in_ms	4,484 (+3%)	17,362	69,350 (+1%)

L2 chain processing

Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric	5 blocks	10 blocks
node_history_sync_time_in_ms	15,560 (+1%)	29,042 (-1%)
note_history_successful_decrypting_time_in_ms	2,254 (+2%)	4,264 (-2%)
note_history_trial_decrypting_time_in_ms	138 (+8%)	168 (-9%)
node_database_size_in_bytes	3,625,186	3,730,370
pxe_database_size_in_bytes	29,923	59,478

Circuits stats

Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit	circuit_simulation_time_in_ms	circuit_input_size_in_bytes	circuit_output_size_in_bytes
private-kernel-init	212	44,681	25,561
private-kernel-ordering	166 (+1%)	43,753	14,809
base-rollup	1,069	128,338	881
root-rollup	81.6 (+1%)	4,088	709
private-kernel-inner	292 (+1%)	71,208	25,561
public-kernel-private-input	206	31,863	25,561
public-kernel-non-first-iteration	204	31,905	25,561
merge-rollup	8.51 (+1%)	2,608	881

Tree insertion stats

The duration to insert a fixed batch of leaves into each tree type.

Metric	1 leaves	2 leaves	8 leaves	16 leaves	32 leaves	64 leaves	128 leaves	512 leaves	1024 leaves	2048 leaves	8192 leaves
batch_insert_into_append_only_tree_ms	11.2 (+1%)	94.4 (+4%)	13.6 (+1%)	18.1 (+2%)	25.7 (+7%)	50.7	90.0	244	470	916 (+1%)	3,622 (+1%)
batch_insert_into_indexed_tree_ms	N/A	N/A	N/A	65.4 (+1%)	N/A	60.6 (+1%)	112 (+1%)	361 (-1%)	738 (-1%)	1,426 (+1%)	5,665 (+2%)

Miscellaneous

Transaction sizes based on how many contracts are deployed in the tx.

Metric	0 deployed contracts	1 deployed contracts
tx_size_in_bytes	15,455	32,231

Transaction processing duration by data writes.

Metric	0 new commitments	1 new commitments
tx_pxe_processing_time_ms	376 (+1%)	1,088 (+1%)

Metric	1 public data writes
tx_sequencer_processing_time_ms	538