Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bump dawidd6/action-download-artifact from 6 to 7 #440

Merged
merged 1 commit into from
Dec 19, 2024
Merged

Bump dawidd6/action-download-artifact from 6 to 7 #440

merged 1 commit into from
Dec 19, 2024

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Dec 2, 2024

Bumps dawidd6/action-download-artifact from 6 to 7.

Release notes

Sourced from dawidd6/action-download-artifact's releases.

v7

What's Changed

New Contributors

Full Changelog: dawidd6/action-download-artifact@v6...v7

Commits
  • 80620a5 node_modules: update
  • b15e003 node_modules: install
  • 1ee9a45 build(deps): Fix cross-spawn >=7.0.0 <= 7.0.5 vulnerability (#317)
  • b2f2706 build(deps): bump @​actions/artifact from 2.1.10 to 2.1.11 (#313)
  • fdbeba0 build(deps): bump @​actions/core from 1.11.0 to 1.11.1 (#312)
  • a74b429 build(deps): bump @​actions/core from 1.10.1 to 1.11.0 (#310)
  • 24e807a build(deps): bump @​actions/artifact from 2.1.9 to 2.1.10 (#311)
  • 9592e3c build(deps): bump path-to-regexp from 6.2.2 to 6.3.0 (#307)
  • 5f966b6 build(deps): bump adm-zip from 0.5.15 to 0.5.16 (#306)
  • db9477a build(deps): bump adm-zip from 0.5.14 to 0.5.15 (#301)
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot
Bump dawidd6/action-download-artifact from 6 to 7
c0d6c5c 
Bumps [dawidd6/action-download-artifact](https://github.com/dawidd6/action-download-artifact) from 6 to 7.
- [Release notes](https://github.com/dawidd6/action-download-artifact/releases)
- [Commits](dawidd6/action-download-artifact@v6...v7)

---
updated-dependencies:
- dependency-name: dawidd6/action-download-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added the dependencies Pull requests that update a dependency file label Dec 2, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Dec 2, 2024 •
edited
Loading

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 2 Dec 2024 - 08:39
  • Baseline: 2 Dec 2024 - 08:46
  • Package commits:
  • Target: 974f13
  • Baseline: 5fcf35
  • Julia commits:
  • Target: 4976d0
  • Baseline: 4976d0
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.89 (5%) ✅ 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 0.98 (5%) 0.99 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.01 (5%) 1.01 (1%) ❌
["pauli", "mul", "20000000"] 1.07 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3127 MHz 2590 s 0 s 148 s 5498 s 0 s
 #2 2445 MHz 4222 s 0 s 151 s 3856 s 0 s
 #3 3243 MHz 1216 s 0 s 164 s 6848 s 0 s
 #4 3228 MHz 1008 s 0 s 134 s 7086 s 0 s
 Memory: 15.606487274169922 GB (13584.234375 MB free)
 Uptime: 827.51 sec
 Load Avg: 1.05 1.07 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2717 MHz 3859 s 0 s 186 s 8243 s 0 s
 #2 2796 MHz 5762 s 0 s 181 s 6339 s 0 s
 #3 3243 MHz 1900 s 0 s 192 s 10188 s 0 s
 #4 2445 MHz 1556 s 0 s 170 s 10554 s 0 s
 Memory: 15.606487274169922 GB (13322.125 MB free)
 Uptime: 1233.46 sec
 Load Avg: 1.0 1.02 0.89
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Dec 2024 - 8:39
  • Package commit: 974f13
  • Julia commit: 4976d0
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.947 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.222 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.094 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 170.890 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.821 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.712 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.087 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.450 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 58.299 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 163.536 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.037 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.860 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.617 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 152.375 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.035 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.685 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.149 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.213 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.344 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 990.132 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.394 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.131 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.508 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 966.839 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.151 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 50.605 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.163 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.309 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.423 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.158 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.526 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.772 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.101 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.418 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.398 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.159 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.425 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.668 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.334 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.619 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.344 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.649 ms (5%) 1.37 MiB (1%) 22151
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.718 ms (5%) 2.70 MiB (1%) 39828
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.060 ms (5%) 2.78 MiB (1%) 40466
["ecc", "evaluate_decoder", "shor_pybp_comm"] 26.530 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 53.347 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 53.578 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 384.782 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.101 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.425 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 776.867 ms (5%) 6.737 ms 167.90 MiB (1%) 576575
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.611 s (5%) 15.966 ms 346.33 MiB (1%) 1201750
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.631 s (5%) 17.736 ms 349.77 MiB (1%) 1223971
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 407.353 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 805.362 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 827.396 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.811 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.363 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.486 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.146 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.486 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.605 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.505 ns (5%)
["pauli", "mul", "1000"] 18.319 ns (5%)
["pauli", "mul", "100000"] 722.707 ns (5%)
["pauli", "mul", "20000000"] 200.024 μs (5%)
["stabilizer", "canon", "cano500"] 2.799 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.687 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.517 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 420.496 μs (5%)
["stabilizer", "canon", "gott500"] 10.662 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.348 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.341 ms (5%)
["stabilizer", "canon", "rref500"] 2.617 ms (5%)
["stabilizer", "project", "destabilizer"] 12.994 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.921 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.504 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.767 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.450 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.681 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3127 MHz 2590 s 0 s 148 s 5498 s 0 s
 #2 2445 MHz 4222 s 0 s 151 s 3856 s 0 s
 #3 3243 MHz 1216 s 0 s 164 s 6848 s 0 s
 #4 3228 MHz 1008 s 0 s 134 s 7086 s 0 s
 Memory: 15.606487274169922 GB (13584.234375 MB free)
 Uptime: 827.51 sec
 Load Avg: 1.05 1.07 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Dec 2024 - 8:46
  • Package commit: 5fcf35
  • Julia commit: 4976d0
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.946 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.219 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.154 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 169.777 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.098 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.672 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.752 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.149 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 57.778 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 162.945 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.035 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.821 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.586 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 152.756 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.034 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.676 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.180 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.524 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.184 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 990.102 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.115 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.508 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 966.688 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.062 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 50.284 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.153 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.259 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.444 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.142 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.505 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 814.333 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.091 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.409 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.479 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.151 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 578.963 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.649 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.334 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.588 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.334 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.687 ms (5%) 1.36 MiB (1%) 22055
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.757 ms (5%) 2.70 MiB (1%) 39852
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.539 ms (5%) 2.84 MiB (1%) 41314
["ecc", "evaluate_decoder", "shor_pybp_comm"] 26.801 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 54.269 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 53.727 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 391.192 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.111 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.436 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 782.728 ms (5%) 9.293 ms 166.81 MiB (1%) 572899
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.639 s (5%) 15.692 ms 350.28 MiB (1%) 1215038
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.613 s (5%) 17.039 ms 345.07 MiB (1%) 1208163
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 394.298 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 823.628 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 827.932 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.881 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.365 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.507 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.131 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.484 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.547 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.094 ns (5%)
["pauli", "mul", "1000"] 18.219 ns (5%)
["pauli", "mul", "100000"] 729.857 ns (5%)
["pauli", "mul", "20000000"] 187.752 μs (5%)
["stabilizer", "canon", "cano500"] 2.799 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.086 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.529 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 419.604 μs (5%)
["stabilizer", "canon", "gott500"] 10.657 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.349 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.343 ms (5%)
["stabilizer", "canon", "rref500"] 2.615 ms (5%)
["stabilizer", "project", "destabilizer"] 13.084 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.931 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.478 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.722 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.379 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.631 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2717 MHz 3859 s 0 s 186 s 8243 s 0 s
 #2 2796 MHz 5762 s 0 s 181 s 6339 s 0 s
 #3 3243 MHz 1900 s 0 s 192 s 10188 s 0 s
 #4 2445 MHz 1556 s 0 s 170 s 10554 s 0 s
 Memory: 15.606487274169922 GB (13322.125 MB free)
 Uptime: 1233.46 sec
 Load Avg: 1.0 1.02 0.89
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 2 Dec 2024 - 08:39
  • Baseline: 2 Dec 2024 - 08:46
  • Package commits:
  • Target: 974f13
  • Baseline: 5fcf35
  • Julia commits:
  • Target: 4976d0
  • Baseline: 4976d0
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.89 (5%) ✅ 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 0.98 (5%) 0.99 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.01 (5%) 1.01 (1%) ❌
["pauli", "mul", "20000000"] 1.07 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3127 MHz 2590 s 0 s 148 s 5498 s 0 s
 #2 2445 MHz 4222 s 0 s 151 s 3856 s 0 s
 #3 3243 MHz 1216 s 0 s 164 s 6848 s 0 s
 #4 3228 MHz 1008 s 0 s 134 s 7086 s 0 s
 Memory: 15.606487274169922 GB (13584.234375 MB free)
 Uptime: 827.51 sec
 Load Avg: 1.05 1.07 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2717 MHz 3859 s 0 s 186 s 8243 s 0 s
 #2 2796 MHz 5762 s 0 s 181 s 6339 s 0 s
 #3 3243 MHz 1900 s 0 s 192 s 10188 s 0 s
 #4 2445 MHz 1556 s 0 s 170 s 10554 s 0 s
 Memory: 15.606487274169922 GB (13322.125 MB free)
 Uptime: 1233.46 sec
 Load Avg: 1.0 1.02 0.89
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Dec 2024 - 8:39
  • Package commit: 974f13
  • Julia commit: 4976d0
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.947 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.222 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.094 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 170.890 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.821 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.712 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.087 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.450 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 58.299 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 163.536 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.037 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.860 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.617 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 152.375 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.035 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.685 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.149 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.213 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.344 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 990.132 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.394 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.131 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.508 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 966.839 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.151 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 50.605 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.163 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.309 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.423 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.158 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.526 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.772 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.101 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.418 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.398 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.159 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.425 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.668 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.334 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.619 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.344 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.649 ms (5%) 1.37 MiB (1%) 22151
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.718 ms (5%) 2.70 MiB (1%) 39828
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.060 ms (5%) 2.78 MiB (1%) 40466
["ecc", "evaluate_decoder", "shor_pybp_comm"] 26.530 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 53.347 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 53.578 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 384.782 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.101 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.425 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 776.867 ms (5%) 6.737 ms 167.90 MiB (1%) 576575
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.611 s (5%) 15.966 ms 346.33 MiB (1%) 1201750
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.631 s (5%) 17.736 ms 349.77 MiB (1%) 1223971
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 407.353 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 805.362 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 827.396 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.811 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.363 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.486 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.146 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.486 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.605 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.505 ns (5%)
["pauli", "mul", "1000"] 18.319 ns (5%)
["pauli", "mul", "100000"] 722.707 ns (5%)
["pauli", "mul", "20000000"] 200.024 μs (5%)
["stabilizer", "canon", "cano500"] 2.799 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.687 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.517 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 420.496 μs (5%)
["stabilizer", "canon", "gott500"] 10.662 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.348 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.341 ms (5%)
["stabilizer", "canon", "rref500"] 2.617 ms (5%)
["stabilizer", "project", "destabilizer"] 12.994 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.921 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.504 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.767 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.450 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.681 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3127 MHz 2590 s 0 s 148 s 5498 s 0 s
 #2 2445 MHz 4222 s 0 s 151 s 3856 s 0 s
 #3 3243 MHz 1216 s 0 s 164 s 6848 s 0 s
 #4 3228 MHz 1008 s 0 s 134 s 7086 s 0 s
 Memory: 15.606487274169922 GB (13584.234375 MB free)
 Uptime: 827.51 sec
 Load Avg: 1.05 1.07 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Dec 2024 - 8:46
  • Package commit: 5fcf35
  • Julia commit: 4976d0
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.946 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.219 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.154 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 169.777 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 14.098 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.672 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.752 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.149 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 57.778 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 162.945 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.035 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.821 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.586 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 152.756 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.034 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.676 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.180 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.524 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.184 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 990.102 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.424 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.115 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.508 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 966.688 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.062 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 50.284 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.153 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.259 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.444 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.142 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.505 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 814.333 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.091 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.409 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.479 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.151 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 578.963 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.649 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.334 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.588 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.334 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.687 ms (5%) 1.36 MiB (1%) 22055
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.757 ms (5%) 2.70 MiB (1%) 39852
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.539 ms (5%) 2.84 MiB (1%) 41314
["ecc", "evaluate_decoder", "shor_pybp_comm"] 26.801 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 54.269 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 53.727 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 391.192 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.111 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.436 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 782.728 ms (5%) 9.293 ms 166.81 MiB (1%) 572899
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.639 s (5%) 15.692 ms 350.28 MiB (1%) 1215038
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.613 s (5%) 17.039 ms 345.07 MiB (1%) 1208163
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 394.298 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 823.628 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 827.932 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.881 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.365 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.507 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.131 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.484 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.547 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.094 ns (5%)
["pauli", "mul", "1000"] 18.219 ns (5%)
["pauli", "mul", "100000"] 729.857 ns (5%)
["pauli", "mul", "20000000"] 187.752 μs (5%)
["stabilizer", "canon", "cano500"] 2.799 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.086 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.529 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 419.604 μs (5%)
["stabilizer", "canon", "gott500"] 10.657 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.349 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.343 ms (5%)
["stabilizer", "canon", "rref500"] 2.615 ms (5%)
["stabilizer", "project", "destabilizer"] 13.084 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.931 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.478 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.722 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.379 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.631 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2717 MHz 3859 s 0 s 186 s 8243 s 0 s
 #2 2796 MHz 5762 s 0 s 181 s 6339 s 0 s
 #3 3243 MHz 1900 s 0 s 192 s 10188 s 0 s
 #4 2445 MHz 1556 s 0 s 170 s 10554 s 0 s
 Memory: 15.606487274169922 GB (13322.125 MB free)
 Uptime: 1233.46 sec
 Load Avg: 1.0 1.02 0.89
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 2 Dec 2024 - 08:39
  • Baseline: 2 Dec 2024 - 08:46
  • Package commits:
  • Target: 974f13
  • Baseline: 5fcf35
  • Julia commits:
  • Target: 4976d0
  • Baseline: 4976d0
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.89 (5%) ✅ 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 0.98 (5%) 0.99 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.01 (5%) 1.01 (1%) ❌
["pauli", "mul", "20000000"] 1.07 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3127 MHz 2590 s 0 s 148 s 5498 s 0 s
 #2 2445 MHz 4222 s 0 s 151 s 3856 s 0 s
 #3 3243 MHz 1216 s 0 s 164 s 6848 s 0 s
 #4 3228 MHz 1008 s 0 s 134 s 7086 s 0 s
 Memory: 15.606487274169922 GB (13584.234375 MB free)
 Uptime: 827.51 sec
 Load Avg: 1.05 1.07 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 2717 MHz 3859 s 0 s 186 s 8243 s 0 s
 #2 2796 MHz 5762 s 0 s 181 s 6339 s 0 s
 #3 3243 MHz 1900 s 0 s 192 s 10188 s 0 s
 #4 2445 MHz 1556 s 0 s 170 s 10554 s 0 s
 Memory: 15.606487274169922 GB (13322.125 MB free)
 Uptime: 1233.46 sec
 Load Avg: 1.0 1.02 0.89
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Dec 2024 - 8:39
  • Package commit: 974f13
  • Julia commit: 4976d0
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.947 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.222 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.094 ms (5%) 500.78 KiB (1%) 18017
["circuitsim", "mctrajectories", "q101_r1"] 170.890 μs (5%) 50.53 KiB (1%) 1816
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.821 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.712 μs (5%) 256 bytes (1%) 6
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.087 ms (5%) 512 bytes (1%) 7
["circuitsim", "mctrajectories_union", "q101_r1"] 117.450 μs (5%) 256 bytes (1%) 6
["circuitsim", "pftrajectories", "q1001_r1"] 58.299 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 163.536 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.037 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.860 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 51.617 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 152.375 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.035 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.685 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 5.149 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.213 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 125.344 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 990.132 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.394 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.131 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_dense500_stab"] 5.508 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_destab"] 966.839 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot250_on_diag500_stab"] 407.151 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "cnot_on_dense500_destab"] 50.605 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_dense500_stab"] 23.163 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_destab"] 26.309 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "cnot_on_diag500_stab"] 12.423 μs (5%) 368 bytes (1%) 5
["clifford", "dense", "dense500_on_dense500_destab"] 11.158 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_dense500_stab"] 5.526 ms (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_destab"] 813.772 μs (5%) 512 bytes (1%) 4
["clifford", "dense", "dense500_on_diag500_stab"] 407.101 μs (5%) 512 bytes (1%) 4
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.418 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 699.398 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.159 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 579.425 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.668 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.334 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.619 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.344 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.649 ms (5%) 1.37 MiB (1%) 22151
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.718 ms (5%) 2.70 MiB (1%) 39828
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.060 ms (5%) 2.78 MiB (1%) 40466
["ecc", "evaluate_decoder", "shor_pybp_comm"] 26.530 ms (5%) 3.94 MiB (1%) 116576
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 53.347 ms (5%) 7.80 MiB (1%) 228190
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 53.578 ms (5%) 7.86 MiB (1%) 228668
["ecc", "evaluate_decoder", "shor_table_comm"] 384.782 μs (5%) 212.08 KiB (1%) 4087
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.101 ms (5%) 286.25 KiB (1%) 3212
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.425 ms (5%) 350.36 KiB (1%) 3690
["ecc", "evaluate_decoder", "toric8_bp_comm"] 776.867 ms (5%) 6.737 ms 167.90 MiB (1%) 576575
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.611 s (5%) 15.966 ms 346.33 MiB (1%) 1201750
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.631 s (5%) 17.736 ms 349.77 MiB (1%) 1223971
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 407.353 ms (5%) 7.23 MiB (1%) 129336
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 805.362 ms (5%) 15.53 MiB (1%) 275496
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 827.396 ms (5%) 17.29 MiB (1%) 292049
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.811 ms (5%) 1.84 MiB (1%) 16937
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.363 ms (5%) 4.69 MiB (1%) 50703
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 22.486 ms (5%) 6.44 MiB (1%) 67256
["ecc", "evaluate_decoder", "toric8_table_comm"] 5.146 ms (5%) 1.63 MiB (1%) 16847
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.486 ms (5%) 4.26 MiB (1%) 50518
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 22.605 ms (5%) 6.01 MiB (1%) 67071
["pauli", "mul", "100"] 14.505 ns (5%)
["pauli", "mul", "1000"] 18.319 ns (5%)
["pauli", "mul", "100000"] 722.707 ns (5%)
["pauli", "mul", "20000000"] 200.024 μs (5%)
["stabilizer", "canon", "cano500"] 2.799 ms (5%)
["stabilizer", "canon", "diag_cano500"] 527.687 μs (5%)
["stabilizer", "canon", "diag_gott500"] 8.517 ms (5%) 5.26 MiB (1%) 24516
["stabilizer", "canon", "diag_rref500"] 420.496 μs (5%)
["stabilizer", "canon", "gott500"] 10.662 ms (5%) 5.27 MiB (1%) 24526
["stabilizer", "canon", "md_cano500"] 1.348 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.341 ms (5%)
["stabilizer", "canon", "rref500"] 2.617 ms (5%)
["stabilizer", "project", "destabilizer"] 12.994 μs (5%) 288 bytes (1%) 3
["stabilizer", "project", "stabilizer"] 5.921 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.504 ms (5%) 23.97 MiB (1%) 31
["stabilizer", "tensor", "pow5_20"] 2.767 μs (5%) 6.48 KiB (1%) 28
["stabilizer", "trace", "destabilizer"] 26.450 μs (5%) 80 bytes (1%) 1
["stabilizer", "trace", "stabilizer"] 21.681 μs (5%) 112 bytes (1%) 2

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.10.7
Commit 4976d05258e (2024-11-26 15:57 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.5 LTS
 uname: Linux 6.5.0-1025-azure #26~22.04.1-Ubuntu SMP Thu Jul 11 22:33:04 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 3127 MHz 2590 s 0 s 148 s 5498 s 0 s
 #2 2445 MHz 4222 s 0 s 151 s 3856 s 0 s
 #3 3243 MHz 1216 s 0 s 164 s 6848 s 0 s
 #4 3228 MHz 1008 s 0 s 134 s 7086 s 0 s
 Memory: 15.606487274169922 GB (13584.234375 MB free)
 Uptime: 827.51 sec
 Load Avg: 1.05 1.07 0.79
 WORD_SIZE: 64
 LIBM: libopenlibm
 LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 2 Dec 2024 - 8:46
  • Package commit: 5fcf35
  • Julia commit: 4976d0
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 5.946 ms (5%)
["circuitsim", "compactification", "no_compact"] 6.219 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.154 ...[Comment body truncated]

@Krastanov Krastanov merged commit 7a1a24b into master Dec 19, 2024
14 of 17 checks passed
@Krastanov Krastanov deleted the dependabot/github_actions/dawidd6/action-download-artifact-7 branch December 19, 2024 19:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@Krastanov