Skip to content

Latest commit

 

History

History
224 lines (202 loc) · 45.2 KB

bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8-vs-base.md

File metadata and controls

224 lines (202 loc) · 45.2 KB
Raw

Results vs. base

  • fork: python
  • ref: f6cc7c8bd01d8468af70
  • machine: darwin-arm64
  • commit hash: f6cc7c8
  • commit date: 2024-10-26
  • overall geometric mean: 1.40x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.23x slower
  • Memory change: 1.11x

Benchmarks with tag 'apps':

Benchmark results/bm-20241026-3.14.0a1+-f6cc7c8/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json results/bm-20241026-3.14.0a1+-f6cc7c8-NOGIL/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json
2to3 160 ms 242 ms: 1.51x slower
docutils 1.40 sec 1.68 sec: 1.20x slower
html5lib 30.1 ms 50.3 ms: 1.67x slower
sphinx 576 ms 715 ms: 1.24x slower
tornado_http 72.4 ms 108 ms: 1.50x slower
Geometric mean (ref) 1.41x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20241026-3.14.0a1+-f6cc7c8/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json results/bm-20241026-3.14.0a1+-f6cc7c8-NOGIL/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json
async_tree_eager_io_tg 704 ms 452 ms: 1.56x faster
async_tree_eager_io 654 ms 474 ms: 1.38x faster
async_tree_io_tg 611 ms 495 ms: 1.23x faster
async_tree_io 583 ms 515 ms: 1.13x faster
async_tree_none_tg 217 ms 203 ms: 1.07x faster
async_tree_cpu_io_mixed_tg 469 ms 459 ms: 1.02x faster
asyncio_websockets 242 ms 238 ms: 1.02x faster
async_tree_cpu_io_mixed 457 ms 483 ms: 1.06x slower
async_tree_eager_cpu_io_mixed_tg 335 ms 367 ms: 1.10x slower
async_tree_eager_cpu_io_mixed 359 ms 394 ms: 1.10x slower
async_tree_memoization_tg 236 ms 260 ms: 1.10x slower
async_tree_memoization 249 ms 283 ms: 1.14x slower
async_tree_none 199 ms 227 ms: 1.14x slower
async_generators 277 ms 327 ms: 1.18x slower
async_tree_eager_memoization 150 ms 182 ms: 1.21x slower
async_tree_eager_memoization_tg 130 ms 159 ms: 1.23x slower
coroutines 16.5 ms 22.8 ms: 1.38x slower
async_tree_eager 61.1 ms 102 ms: 1.67x slower
async_tree_eager_tg 42.3 ms 72.8 ms: 1.72x slower
Geometric mean (ref) 1.07x slower

Benchmarks with tag 'math':

Benchmark results/bm-20241026-3.14.0a1+-f6cc7c8/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json results/bm-20241026-3.14.0a1+-f6cc7c8-NOGIL/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json
pidigits 283 ms 282 ms: 1.01x faster
float 49.8 ms 93.1 ms: 1.87x slower
nbody 66.0 ms 149 ms: 2.26x slower
Geometric mean (ref) 1.61x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20241026-3.14.0a1+-f6cc7c8/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json results/bm-20241026-3.14.0a1+-f6cc7c8-NOGIL/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json
regex_dna 142 ms 135 ms: 1.05x faster
regex_effbot 2.45 ms 2.35 ms: 1.04x faster
regex_v8 16.6 ms 16.3 ms: 1.02x faster
regex_compile 68.1 ms 118 ms: 1.74x slower
Geometric mean (ref) 1.12x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20241026-3.14.0a1+-f6cc7c8/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json results/bm-20241026-3.14.0a1+-f6cc7c8-NOGIL/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json
xml_etree_parse 108 ms 98.2 ms: 1.10x faster
json_loads 16.6 us 18.2 us: 1.10x slower
json_dumps 7.18 ms 8.69 ms: 1.21x slower
xml_etree_generate 52.3 ms 65.6 ms: 1.25x slower
tomli_loads 1.49 sec 1.97 sec: 1.32x slower
xml_etree_process 37.2 ms 53.2 ms: 1.43x slower
unpickle_pure_python 142 us 261 us: 1.83x slower
pickle_pure_python 183 us 338 us: 1.85x slower
Geometric mean (ref) 1.29x slower

Benchmark hidden because not significant (1): xml_etree_iterparse

Benchmarks with tag 'startup':

Benchmark results/bm-20241026-3.14.0a1+-f6cc7c8/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json results/bm-20241026-3.14.0a1+-f6cc7c8-NOGIL/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json
python_startup 18.9 ms 20.6 ms: 1.09x slower
python_startup_no_site 14.3 ms 16.1 ms: 1.12x slower
Geometric mean (ref) 1.11x slower

Benchmarks with tag 'template':

Benchmark results/bm-20241026-3.14.0a1+-f6cc7c8/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json results/bm-20241026-3.14.0a1+-f6cc7c8-NOGIL/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json
genshi_xml 30.1 ms 48.0 ms: 1.59x slower
genshi_text 13.8 ms 23.5 ms: 1.70x slower
django_template 19.9 ms 34.1 ms: 1.72x slower
mako 6.97 ms 13.4 ms: 1.92x slower
Geometric mean (ref) 1.73x slower

All benchmarks:

Benchmark results/bm-20241026-3.14.0a1+-f6cc7c8/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json results/bm-20241026-3.14.0a1+-f6cc7c8-NOGIL/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json
async_tree_eager_io_tg 704 ms 452 ms: 1.56x faster
async_tree_eager_io 654 ms 474 ms: 1.38x faster
async_tree_io_tg 611 ms 495 ms: 1.23x faster
create_gc_cycles 1.31 ms 1.09 ms: 1.20x faster
gc_traversal 2.93 ms 2.51 ms: 1.17x faster
async_tree_io 583 ms 515 ms: 1.13x faster
xml_etree_parse 108 ms 98.2 ms: 1.10x faster
async_tree_none_tg 217 ms 203 ms: 1.07x faster
regex_dna 142 ms 135 ms: 1.05x faster
regex_effbot 2.45 ms 2.35 ms: 1.04x faster
async_tree_cpu_io_mixed_tg 469 ms 459 ms: 1.02x faster
regex_v8 16.6 ms 16.3 ms: 1.02x faster
asyncio_websockets 242 ms 238 ms: 1.02x faster
pidigits 283 ms 282 ms: 1.01x faster
async_tree_cpu_io_mixed 457 ms 483 ms: 1.06x slower
python_startup 18.9 ms 20.6 ms: 1.09x slower
async_tree_eager_cpu_io_mixed_tg 335 ms 367 ms: 1.10x slower
async_tree_eager_cpu_io_mixed 359 ms 394 ms: 1.10x slower
json_loads 16.6 us 18.2 us: 1.10x slower
async_tree_memoization_tg 236 ms 260 ms: 1.10x slower
json 2.90 ms 3.22 ms: 1.11x slower
pathlib 22.0 ms 24.5 ms: 1.11x slower
python_startup_no_site 14.3 ms 16.1 ms: 1.12x slower
async_tree_memoization 249 ms 283 ms: 1.14x slower
async_tree_none 199 ms 227 ms: 1.14x slower
bench_mp_pool 59.9 ms 68.9 ms: 1.15x slower
pylint 179 ms 209 ms: 1.17x slower
async_generators 277 ms 327 ms: 1.18x slower
telco 4.59 ms 5.43 ms: 1.18x slower
docutils 1.40 sec 1.68 sec: 1.20x slower
json_dumps 7.18 ms 8.69 ms: 1.21x slower
coverage 43.7 ms 52.9 ms: 1.21x slower
async_tree_eager_memoization 150 ms 182 ms: 1.21x slower
async_tree_eager_memoization_tg 130 ms 159 ms: 1.23x slower
mdp 1.48 sec 1.82 sec: 1.23x slower
sphinx 576 ms 715 ms: 1.24x slower
meteor_contest 70.6 ms 88.1 ms: 1.25x slower
xml_etree_generate 52.3 ms 65.6 ms: 1.25x slower
bpe_tokeniser 3.11 sec 3.90 sec: 1.26x slower
tomli_loads 1.49 sec 1.97 sec: 1.32x slower
fannkuch 267 ms 356 ms: 1.33x slower
nqueens 54.8 ms 73.4 ms: 1.34x slower
scimark_fft 192 ms 262 ms: 1.37x slower
coroutines 16.5 ms 22.8 ms: 1.38x slower
xml_etree_process 37.2 ms 53.2 ms: 1.43x slower
pycparser 635 ms 909 ms: 1.43x slower
sympy_integrate 11.0 ms 15.9 ms: 1.45x slower
dulwich_log 27.6 ms 40.2 ms: 1.45x slower
pyflate 326 ms 477 ms: 1.46x slower
scimark_sparse_mat_mult 2.82 ms 4.22 ms: 1.49x slower
tornado_http 72.4 ms 108 ms: 1.50x slower
2to3 160 ms 242 ms: 1.51x slower
crypto_pyaes 51.7 ms 78.4 ms: 1.52x slower
deepcopy_reduce 1.54 us 2.34 us: 1.52x slower
typing_runtime_protocols 93.0 us 143 us: 1.54x slower
generators 20.1 ms 31.0 ms: 1.54x slower
sqlalchemy_imperative 6.36 ms 9.86 ms: 1.55x slower
thrift 419 us 650 us: 1.55x slower
sqlglot_normalize 166 ms 261 ms: 1.57x slower
sqlalchemy_declarative 56.0 ms 89.3 ms: 1.59x slower
genshi_xml 30.1 ms 48.0 ms: 1.59x slower
sqlglot_optimize 31.1 ms 49.9 ms: 1.61x slower
deepcopy 145 us 234 us: 1.62x slower
scimark_sor 96.1 ms 156 ms: 1.62x slower
async_tree_eager 61.1 ms 102 ms: 1.67x slower
html5lib 30.1 ms 50.3 ms: 1.67x slower
comprehensions 11.4 us 19.1 us: 1.68x slower
sympy_str 134 ms 226 ms: 1.69x slower
genshi_text 13.8 ms 23.5 ms: 1.70x slower
django_template 19.9 ms 34.1 ms: 1.72x slower
async_tree_eager_tg 42.3 ms 72.8 ms: 1.72x slower
richards 31.1 ms 53.7 ms: 1.72x slower
pprint_pformat 935 ms 1.62 sec: 1.73x slower
pprint_safe_repr 459 ms 796 ms: 1.73x slower
regex_compile 68.1 ms 118 ms: 1.74x slower
bench_thread_pool 453 us 794 us: 1.75x slower
scimark_monte_carlo 44.2 ms 77.7 ms: 1.76x slower
deepcopy_memo 17.0 us 29.9 us: 1.76x slower
richards_super 34.6 ms 61.9 ms: 1.79x slower
spectral_norm 70.0 ms 127 ms: 1.82x slower
sympy_expand 226 ms 415 ms: 1.83x slower
unpickle_pure_python 142 us 261 us: 1.83x slower
pickle_pure_python 183 us 338 us: 1.85x slower
hexiom 4.13 ms 7.66 ms: 1.86x slower
float 49.8 ms 93.1 ms: 1.87x slower
logging_simple 3.03 us 5.70 us: 1.88x slower
logging_format 3.31 us 6.22 us: 1.88x slower
mako 6.97 ms 13.4 ms: 1.92x slower
sympy_sum 69.8 ms 136 ms: 1.95x slower
chaos 36.8 ms 75.1 ms: 2.04x slower
sqlglot_transpile 902 us 1.84 ms: 2.04x slower
scimark_lu 67.0 ms 142 ms: 2.12x slower
go 82.4 ms 178 ms: 2.15x slower
logging_silent 60.9 ns 131 ns: 2.15x slower
sqlglot_parse 746 us 1.63 ms: 2.18x slower
nbody 66.0 ms 149 ms: 2.26x slower
raytrace 154 ms 357 ms: 2.33x slower
deltablue 2.24 ms 5.41 ms: 2.42x slower
Geometric mean (ref) 1.40x slower

Benchmark hidden because not significant (1): xml_etree_iterparse

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.25x
  • 95% likely to have a slowdown of 1.24x
  • 99% likely to have a slowdown of 1.23x

Memory

  • memory change: 1.11x