Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CI autocancel #429

Merged
merged 1 commit into from
Nov 21, 2024
Merged

CI autocancel #429

merged 1 commit into from
Nov 21, 2024

Conversation

Krastanov
Copy link
Member

No description provided.

@codecov Codecov
Copy link

codecov bot commented Nov 21, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 83.02%. Comparing base (ce1dc02) to head (1e0a1f9).
Report is 1 commits behind head on master.

Additional details and impacted files 
@@            Coverage Diff             @@
##           master     #429      +/-   ##
==========================================
- Coverage   83.08%   83.02%   -0.07%     
==========================================
  Files          71       71              
  Lines        4565     4565              
==========================================
- Hits         3793     3790       -3     
- Misses        772      775       +3

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚨 Try these New Features:

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Nov 21, 2024 •
edited
Loading

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 21 Nov 2024 - 17:25
  • Baseline: 21 Nov 2024 - 17:32
  • Package commits:
  • Target: f1a2f6
  • Baseline: ce1dc0
  • Julia commits:
  • Target: 67dffc
  • Baseline: 67dffc
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 0.95 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r100"] 0.94 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 0.95 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot_on_dense500_destab"] 1.15 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.92 (5%) ✅ 0.97 (1%) ✅
["ecc", "evaluate_decoder", "shor_table_comm"] 0.85 (5%) ✅ 1.00 (1%)
["ecc", "evaluate_decoder", "toric8_bp_comm"] 0.95 (5%) ✅ 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_table_comm"] 0.85 (5%) ✅ 1.00 (1%)
["pauli", "mul", "20000000"] 0.94 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3256 MHz 2721 s 0 s 134 s 5680 s 0 s
 #2 3242 MHz 2441 s 0 s 130 s 5969 s 0 s
 #3 3220 MHz 1881 s 0 s 150 s 6484 s 0 s
 #4 3225 MHz 1522 s 0 s 172 s 6842 s 0 s
 Memory: 15.606487274169922 GB (13568.70703125 MB free)
 Uptime: 857.66 sec
 Load Avg: 1.02 1.05 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 4264 s 0 s 162 s 8124 s 0 s
 #2 2445 MHz 4486 s 0 s 150 s 7919 s 0 s
 #3 3242 MHz 2191 s 0 s 188 s 10149 s 0 s
 #4 3246 MHz 1620 s 0 s 214 s 10714 s 0 s
 Memory: 15.606487274169922 GB (13497.390625 MB free)
 Uptime: 1259.69 sec
 Load Avg: 1.0 1.02 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 21 Nov 2024 - 17:25
  • Package commit: f1a2f6
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.954 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.210 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.557 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 180.209 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.382 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.111 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.235 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 116.529 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 58.590 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 161.052 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.025 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.881 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.407 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.232 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.023 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.739 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.109 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.524 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 123.622 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 978.568 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.251 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.506 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 963.325 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.048 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 57.659 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 22.763 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 27.371 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 11.842 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.249 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.499 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.433 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.076 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.423 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 702.021 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.165 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 585.358 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.699 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.354 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.669 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.354 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.679 ms (5%) 1.38 MiB (1%) 22255
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.738 ms (5%) 2.69 MiB (1%) 39676
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.085 ms (5%) 2.77 MiB (1%) 40402
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.453 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 51.558 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 52.066 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 385.572 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.091 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.416 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 786.786 ms (5%) 6.682 ms 169.55 MiB (1%) 582115
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.654 s (5%) 16.735 ms 351.95 MiB (1%) 1220646
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.658 s (5%) 18.023 ms 354.18 MiB (1%) 1238799
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 389.677 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 798.322 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 820.022 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.870 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.395 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.691 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.176 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.497 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.679 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.114 ns (5%)
["pauli", "mul", "1000"] 18.219 ns (5%)
["pauli", "mul", "100000"] 725.806 ns (5%)
["pauli", "mul", "20000000"] 181.371 μs (5%)
["stabilizer", "canon", "cano500"] 2.816 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.746 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.486 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 428.288 μs (5%)
["stabilizer", "canon", "gott500"] 10.742 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.367 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.347 ms (5%)
["stabilizer", "canon", "rref500"] 2.649 ms (5%)
["stabilizer", "project", "destabilizer"] 13.004 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.901 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.448 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.881 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.640 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.049 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3256 MHz 2721 s 0 s 134 s 5680 s 0 s
 #2 3242 MHz 2441 s 0 s 130 s 5969 s 0 s
 #3 3220 MHz 1881 s 0 s 150 s 6484 s 0 s
 #4 3225 MHz 1522 s 0 s 172 s 6842 s 0 s
 Memory: 15.606487274169922 GB (13568.70703125 MB free)
 Uptime: 857.66 sec
 Load Avg: 1.02 1.05 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 21 Nov 2024 - 17:32
  • Package commit: ce1dc0
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 6.007 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.243 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.124 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 181.651 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.094 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.462 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.035 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.129 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 61.947 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 172.133 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.049 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.221 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.406 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 152.175 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.037 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.696 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.110 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.524 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.525 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 989.715 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.262 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.500 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 963.308 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.044 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 50.034 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 22.832 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.961 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 11.731 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.252 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.496 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 817.383 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.071 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.409 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 701.916 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.149 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 585.608 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.648 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.354 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.588 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.345 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.761 ms (5%) 1.38 MiB (1%) 22247
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.728 ms (5%) 2.71 MiB (1%) 39980
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.451 ms (5%) 2.85 MiB (1%) 41522
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.659 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 52.303 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 52.093 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 455.684 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.101 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.426 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 830.481 ms (5%) 9.821 ms 173.77 MiB (1%) 596283
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.678 s (5%) 15.186 ms 352.24 MiB (1%) 1221630
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.686 s (5%) 16.105 ms 354.47 MiB (1%) 1239767
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 388.769 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 834.350 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 805.574 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.873 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.367 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.467 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 6.078 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.537 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.521 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 13.894 ns (5%)
["pauli", "mul", "1000"] 18.229 ns (5%)
["pauli", "mul", "100000"] 727.411 ns (5%)
["pauli", "mul", "20000000"] 193.643 μs (5%)
["stabilizer", "canon", "cano500"] 2.821 ms (5%)
["stabilizer", "canon", "diag_cano500"] 526.225 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.516 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 426.880 μs (5%)
["stabilizer", "canon", "gott500"] 10.740 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.359 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.348 ms (5%)
["stabilizer", "canon", "rref500"] 2.673 ms (5%)
["stabilizer", "project", "destabilizer"] 13.024 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.900 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.472 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.819 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.550 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.821 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 4264 s 0 s 162 s 8124 s 0 s
 #2 2445 MHz 4486 s 0 s 150 s 7919 s 0 s
 #3 3242 MHz 2191 s 0 s 188 s 10149 s 0 s
 #4 3246 MHz 1620 s 0 s 214 s 10714 s 0 s
 Memory: 15.606487274169922 GB (13497.390625 MB free)
 Uptime: 1259.69 sec
 Load Avg: 1.0 1.02 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 21 Nov 2024 - 17:25
  • Baseline: 21 Nov 2024 - 17:32
  • Package commits:
  • Target: f1a2f6
  • Baseline: ce1dc0
  • Julia commits:
  • Target: 67dffc
  • Baseline: 67dffc
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 0.95 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r100"] 0.94 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 0.95 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot_on_dense500_destab"] 1.15 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.92 (5%) ✅ 0.97 (1%) ✅
["ecc", "evaluate_decoder", "shor_table_comm"] 0.85 (5%) ✅ 1.00 (1%)
["ecc", "evaluate_decoder", "toric8_bp_comm"] 0.95 (5%) ✅ 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_table_comm"] 0.85 (5%) ✅ 1.00 (1%)
["pauli", "mul", "20000000"] 0.94 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3256 MHz 2721 s 0 s 134 s 5680 s 0 s
 #2 3242 MHz 2441 s 0 s 130 s 5969 s 0 s
 #3 3220 MHz 1881 s 0 s 150 s 6484 s 0 s
 #4 3225 MHz 1522 s 0 s 172 s 6842 s 0 s
 Memory: 15.606487274169922 GB (13568.70703125 MB free)
 Uptime: 857.66 sec
 Load Avg: 1.02 1.05 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 4264 s 0 s 162 s 8124 s 0 s
 #2 2445 MHz 4486 s 0 s 150 s 7919 s 0 s
 #3 3242 MHz 2191 s 0 s 188 s 10149 s 0 s
 #4 3246 MHz 1620 s 0 s 214 s 10714 s 0 s
 Memory: 15.606487274169922 GB (13497.390625 MB free)
 Uptime: 1259.69 sec
 Load Avg: 1.0 1.02 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 21 Nov 2024 - 17:25
  • Package commit: f1a2f6
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.954 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.210 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.557 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 180.209 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.382 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.111 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.235 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 116.529 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 58.590 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 161.052 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.025 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.881 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.407 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.232 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.023 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.739 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.109 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.524 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 123.622 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 978.568 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.251 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.506 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 963.325 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.048 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 57.659 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 22.763 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 27.371 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 11.842 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.249 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.499 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.433 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.076 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.423 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 702.021 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.165 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 585.358 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.699 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.354 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.669 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.354 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.679 ms (5%) 1.38 MiB (1%) 22255
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.738 ms (5%) 2.69 MiB (1%) 39676
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.085 ms (5%) 2.77 MiB (1%) 40402
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.453 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 51.558 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 52.066 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 385.572 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.091 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.416 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 786.786 ms (5%) 6.682 ms 169.55 MiB (1%) 582115
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.654 s (5%) 16.735 ms 351.95 MiB (1%) 1220646
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.658 s (5%) 18.023 ms 354.18 MiB (1%) 1238799
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 389.677 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 798.322 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 820.022 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.870 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.395 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.691 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.176 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.497 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.679 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.114 ns (5%)
["pauli", "mul", "1000"] 18.219 ns (5%)
["pauli", "mul", "100000"] 725.806 ns (5%)
["pauli", "mul", "20000000"] 181.371 μs (5%)
["stabilizer", "canon", "cano500"] 2.816 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.746 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.486 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 428.288 μs (5%)
["stabilizer", "canon", "gott500"] 10.742 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.367 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.347 ms (5%)
["stabilizer", "canon", "rref500"] 2.649 ms (5%)
["stabilizer", "project", "destabilizer"] 13.004 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.901 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.448 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.881 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.640 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.049 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3256 MHz 2721 s 0 s 134 s 5680 s 0 s
 #2 3242 MHz 2441 s 0 s 130 s 5969 s 0 s
 #3 3220 MHz 1881 s 0 s 150 s 6484 s 0 s
 #4 3225 MHz 1522 s 0 s 172 s 6842 s 0 s
 Memory: 15.606487274169922 GB (13568.70703125 MB free)
 Uptime: 857.66 sec
 Load Avg: 1.02 1.05 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 21 Nov 2024 - 17:32
  • Package commit: ce1dc0
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 6.007 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.243 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.124 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 181.651 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.094 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.462 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.035 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.129 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 61.947 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 172.133 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.049 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.221 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.406 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 152.175 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.037 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.696 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.110 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.524 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.525 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 989.715 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.262 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.500 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 963.308 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.044 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 50.034 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 22.832 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.961 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 11.731 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.252 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.496 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 817.383 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.071 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.409 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 701.916 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.149 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 585.608 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.648 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.354 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.588 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.345 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.761 ms (5%) 1.38 MiB (1%) 22247
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.728 ms (5%) 2.71 MiB (1%) 39980
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.451 ms (5%) 2.85 MiB (1%) 41522
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.659 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 52.303 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 52.093 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 455.684 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.101 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.426 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 830.481 ms (5%) 9.821 ms 173.77 MiB (1%) 596283
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.678 s (5%) 15.186 ms 352.24 MiB (1%) 1221630
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.686 s (5%) 16.105 ms 354.47 MiB (1%) 1239767
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 388.769 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 834.350 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 805.574 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.873 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.367 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.467 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 6.078 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.537 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.521 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 13.894 ns (5%)
["pauli", "mul", "1000"] 18.229 ns (5%)
["pauli", "mul", "100000"] 727.411 ns (5%)
["pauli", "mul", "20000000"] 193.643 μs (5%)
["stabilizer", "canon", "cano500"] 2.821 ms (5%)
["stabilizer", "canon", "diag_cano500"] 526.225 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.516 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 426.880 μs (5%)
["stabilizer", "canon", "gott500"] 10.740 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.359 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.348 ms (5%)
["stabilizer", "canon", "rref500"] 2.673 ms (5%)
["stabilizer", "project", "destabilizer"] 13.024 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.900 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.472 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.819 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.550 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.821 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 4264 s 0 s 162 s 8124 s 0 s
 #2 2445 MHz 4486 s 0 s 150 s 7919 s 0 s
 #3 3242 MHz 2191 s 0 s 188 s 10149 s 0 s
 #4 3246 MHz 1620 s 0 s 214 s 10714 s 0 s
 Memory: 15.606487274169922 GB (13497.390625 MB free)
 Uptime: 1259.69 sec
 Load Avg: 1.0 1.02 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 21 Nov 2024 - 17:25
  • Baseline: 21 Nov 2024 - 17:32
  • Package commits:
  • Target: f1a2f6
  • Baseline: ce1dc0
  • Julia commits:
  • Target: 67dffc
  • Baseline: 67dffc
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories", "q1001_r1"] 0.95 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r100"] 0.94 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 0.95 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot_on_dense500_destab"] 1.15 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.92 (5%) ✅ 0.97 (1%) ✅
["ecc", "evaluate_decoder", "shor_table_comm"] 0.85 (5%) ✅ 1.00 (1%)
["ecc", "evaluate_decoder", "toric8_bp_comm"] 0.95 (5%) ✅ 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_table_comm"] 0.85 (5%) ✅ 1.00 (1%)
["pauli", "mul", "20000000"] 0.94 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3256 MHz 2721 s 0 s 134 s 5680 s 0 s
 #2 3242 MHz 2441 s 0 s 130 s 5969 s 0 s
 #3 3220 MHz 1881 s 0 s 150 s 6484 s 0 s
 #4 3225 MHz 1522 s 0 s 172 s 6842 s 0 s
 Memory: 15.606487274169922 GB (13568.70703125 MB free)
 Uptime: 857.66 sec
 Load Avg: 1.02 1.05 0.74
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2445 MHz 4264 s 0 s 162 s 8124 s 0 s
 #2 2445 MHz 4486 s 0 s 150 s 7919 s 0 s
 #3 3242 MHz 2191 s 0 s 188 s 10149 s 0 s
 #4 3246 MHz 1620 s 0 s 214 s 10714 s 0 s
 Memory: 15.606487274169922 GB (13497.390625 MB free)
 Uptime: 1259.69 sec
 Load Avg: 1.0 1.02 0.85
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 21 Nov 2024 - 17:25
  • Package commit: f1a2f6
  • Julia commit: 67dffc
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.954 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.210 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.557 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 180.209 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.382 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.111 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.235 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 116.529 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 58.590 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 161.052 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.025 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.881 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.407 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.232 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.023 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.739 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.109 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.524 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 123.622 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 978.568 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.251 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.506 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 963.325 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.048 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 57.659 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 22.763 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 27.371 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 11.842 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.249 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.499 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.433 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.076 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.423 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 702.021 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.165 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 585.358 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.699 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.354 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.669 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.354 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.679 ms (5%) 1.38 MiB (1%) 22255
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.738 ms (5%) 2.69 MiB (1%) 39676
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.085 ms (5%) 2.77 MiB (1%) 40402
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.453 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 51.558 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 52.066 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 385.572 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.091 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.416 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 786.786 ms (5%) 6.682 ms 169.55 MiB (1%) 582115
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.654 s (5%) 16.735 ms 351.95 MiB (1%) 1220646
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.658 s (5%) 18.023 ms 354.18 MiB (1%) 1238799
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 389.677 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 798.322 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 820.022 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.870 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.395 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.691 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.176 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.497 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.679 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.114 ns (5%)
["pauli", "mul", "1000"] 18.219 ns (5%)
["pauli", "mul", "100000"] 725.806 ns (5%)
["pauli", "mul", "20000000"] 181.371 μs (5%)
["stabilizer", "canon", "cano500"] 2.816 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.746 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.486 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 428.288 μs (5%)
["stabilizer", "canon", "gott500"] 10.742 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.367 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.347 ms (5%)
["stabilizer", "canon", "rref500"] 2.649 ms (5%)
["stabilizer", "project", "destabilizer"] 13.004 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.901 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.448 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.881 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.640 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.049 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.6
Commit 67dffc4a8ae (2024-10-28 12:23 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3256 MHz 2721 s 0 s 134 s 5680 s 0 s
 #2 3242 MHz 24...*[Comment body truncated]*

@Krastanov Krastanov merged commit 5fcf353 into master Nov 21, 2024
15 of 18 checks passed
@Krastanov Krastanov deleted the ciautocancel branch November 21, 2024 17:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@Krastanov