fork: python
ref: f6cc7c8bd01d8468af70
machine: darwin-arm64
commit hash: f6cc7c8
commit date: 2024-10-26
overall geometric mean: 1.30x slower
HPT reliability: 100.00%
HPT 99th percentile: 1.16x slower
Memory change: 6.64x
Benchmarks with tag 'apps':
Benchmark
bm-20241007-darwin-arm64-python-v3.13.0-3.13.0-60403a5
bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8
2to3
178 ms
242 ms: 1.36x slower
docutils
1.44 sec
1.68 sec: 1.16x slower
html5lib
36.6 ms
50.3 ms: 1.37x slower
tornado_http
77.2 ms
108 ms: 1.41x slower
Geometric mean
(ref)
1.32x slower
Benchmarks with tag 'asyncio':
Benchmark
bm-20241007-darwin-arm64-python-v3.13.0-3.13.0-60403a5
bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8
async_tree_memoization_tg
291 ms
260 ms: 1.12x faster
async_tree_eager_io
513 ms
474 ms: 1.08x faster
async_tree_eager_io_tg
477 ms
452 ms: 1.05x faster
asyncio_websockets
241 ms
238 ms: 1.01x faster
async_tree_io
507 ms
515 ms: 1.02x slower
async_tree_none_tg
198 ms
203 ms: 1.02x slower
async_tree_cpu_io_mixed_tg
447 ms
459 ms: 1.03x slower
async_tree_memoization
270 ms
283 ms: 1.05x slower
async_tree_cpu_io_mixed
460 ms
483 ms: 1.05x slower
async_tree_eager_cpu_io_mixed
375 ms
394 ms: 1.05x slower
async_tree_eager_cpu_io_mixed_tg
348 ms
367 ms: 1.05x slower
async_tree_none
212 ms
227 ms: 1.07x slower
async_tree_eager_memoization
169 ms
182 ms: 1.08x slower
async_generators
294 ms
327 ms: 1.11x slower
async_tree_eager_memoization_tg
139 ms
159 ms: 1.15x slower
coroutines
19.8 ms
22.8 ms: 1.15x slower
async_tree_eager
70.5 ms
102 ms: 1.45x slower
async_tree_eager_tg
48.4 ms
72.8 ms: 1.50x slower
Geometric mean
(ref)
1.07x slower
Benchmark hidden because not significant (1): async_tree_io_tg
Benchmarks with tag 'math':
Benchmark
bm-20241007-darwin-arm64-python-v3.13.0-3.13.0-60403a5
bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8
pidigits
284 ms
282 ms: 1.01x faster
float
56.2 ms
93.1 ms: 1.66x slower
nbody
73.9 ms
149 ms: 2.02x slower
Geometric mean
(ref)
1.49x slower
Benchmarks with tag 'regex':
Benchmark
bm-20241007-darwin-arm64-python-v3.13.0-3.13.0-60403a5
bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8
regex_effbot
2.63 ms
2.35 ms: 1.12x faster
regex_dna
148 ms
135 ms: 1.09x faster
regex_v8
16.9 ms
16.3 ms: 1.04x faster
regex_compile
78.5 ms
118 ms: 1.51x slower
Geometric mean
(ref)
1.04x slower
Benchmarks with tag 'serialize':
Benchmark
bm-20241007-darwin-arm64-python-v3.13.0-3.13.0-60403a5
bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8
xml_etree_parse
109 ms
98.2 ms: 1.11x faster
xml_etree_iterparse
74.2 ms
74.9 ms: 1.01x slower
json_loads
16.9 us
18.2 us: 1.08x slower
xml_etree_generate
56.6 ms
65.6 ms: 1.16x slower
tomli_loads
1.56 sec
1.97 sec: 1.27x slower
xml_etree_process
40.9 ms
53.2 ms: 1.30x slower
json_dumps
6.56 ms
8.69 ms: 1.32x slower
pickle_pure_python
213 us
338 us: 1.59x slower
unpickle_pure_python
163 us
261 us: 1.60x slower
Geometric mean
(ref)
1.23x slower
Benchmarks with tag 'startup':
Benchmark
bm-20241007-darwin-arm64-python-v3.13.0-3.13.0-60403a5
bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8
python_startup_no_site
13.7 ms
16.1 ms: 1.18x slower
python_startup
17.0 ms
20.6 ms: 1.21x slower
Geometric mean
(ref)
1.20x slower
Benchmarks with tag 'template':
Benchmark
bm-20241007-darwin-arm64-python-v3.13.0-3.13.0-60403a5
bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8
genshi_text
16.9 ms
23.5 ms: 1.39x slower
genshi_xml
34.4 ms
48.0 ms: 1.39x slower
django_template
22.2 ms
34.1 ms: 1.54x slower
mako
7.68 ms
13.4 ms: 1.75x slower
Geometric mean
(ref)
1.51x slower
Benchmark
bm-20241007-darwin-arm64-python-v3.13.0-3.13.0-60403a5
bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8
regex_effbot
2.63 ms
2.35 ms: 1.12x faster
async_tree_memoization_tg
291 ms
260 ms: 1.12x faster
xml_etree_parse
109 ms
98.2 ms: 1.11x faster
regex_dna
148 ms
135 ms: 1.09x faster
async_tree_eager_io
513 ms
474 ms: 1.08x faster
async_tree_eager_io_tg
477 ms
452 ms: 1.05x faster
regex_v8
16.9 ms
16.3 ms: 1.04x faster
generators
31.5 ms
31.0 ms: 1.02x faster
asyncio_websockets
241 ms
238 ms: 1.01x faster
pidigits
284 ms
282 ms: 1.01x faster
deepcopy
232 us
234 us: 1.01x slower
gc_traversal
2.48 ms
2.51 ms: 1.01x slower
xml_etree_iterparse
74.2 ms
74.9 ms: 1.01x slower
async_tree_io
507 ms
515 ms: 1.02x slower
async_tree_none_tg
198 ms
203 ms: 1.02x slower
async_tree_cpu_io_mixed_tg
447 ms
459 ms: 1.03x slower
async_tree_memoization
270 ms
283 ms: 1.05x slower
async_tree_cpu_io_mixed
460 ms
483 ms: 1.05x slower
async_tree_eager_cpu_io_mixed
375 ms
394 ms: 1.05x slower
async_tree_eager_cpu_io_mixed_tg
348 ms
367 ms: 1.05x slower
async_tree_none
212 ms
227 ms: 1.07x slower
pathlib
22.8 ms
24.5 ms: 1.07x slower
async_tree_eager_memoization
169 ms
182 ms: 1.08x slower
json_loads
16.9 us
18.2 us: 1.08x slower
json
2.94 ms
3.22 ms: 1.09x slower
deepcopy_memo
27.2 us
29.9 us: 1.10x slower
async_generators
294 ms
327 ms: 1.11x slower
telco
4.80 ms
5.43 ms: 1.13x slower
deepcopy_reduce
2.06 us
2.34 us: 1.14x slower
coverage
46.1 ms
52.9 ms: 1.15x slower
async_tree_eager_memoization_tg
139 ms
159 ms: 1.15x slower
coroutines
19.8 ms
22.8 ms: 1.15x slower
pylint
181 ms
209 ms: 1.16x slower
xml_etree_generate
56.6 ms
65.6 ms: 1.16x slower
docutils
1.44 sec
1.68 sec: 1.16x slower
nqueens
62.9 ms
73.4 ms: 1.17x slower
python_startup_no_site
13.7 ms
16.1 ms: 1.18x slower
meteor_contest
73.8 ms
88.1 ms: 1.19x slower
bpe_tokeniser
3.24 sec
3.90 sec: 1.20x slower
python_startup
17.0 ms
20.6 ms: 1.21x slower
mdp
1.50 sec
1.82 sec: 1.22x slower
fannkuch
282 ms
356 ms: 1.27x slower
tomli_loads
1.56 sec
1.97 sec: 1.27x slower
pycparser
706 ms
909 ms: 1.29x slower
xml_etree_process
40.9 ms
53.2 ms: 1.30x slower
scimark_fft
201 ms
262 ms: 1.31x slower
json_dumps
6.56 ms
8.69 ms: 1.32x slower
bench_mp_pool
50.9 ms
68.9 ms: 1.35x slower
pyflate
351 ms
477 ms: 1.36x slower
2to3
178 ms
242 ms: 1.36x slower
create_gc_cycles
803 us
1.09 ms: 1.36x slower
html5lib
36.6 ms
50.3 ms: 1.37x slower
sqlglot_normalize
189 ms
261 ms: 1.39x slower
genshi_text
16.9 ms
23.5 ms: 1.39x slower
genshi_xml
34.4 ms
48.0 ms: 1.39x slower
thrift
466 us
650 us: 1.40x slower
dulwich_log
28.7 ms
40.2 ms: 1.40x slower
sympy_integrate
11.3 ms
15.9 ms: 1.41x slower
tornado_http
77.2 ms
108 ms: 1.41x slower
scimark_sparse_mat_mult
2.99 ms
4.22 ms: 1.41x slower
typing_runtime_protocols
101 us
143 us: 1.42x slower
sqlglot_optimize
34.9 ms
49.9 ms: 1.43x slower
async_tree_eager
70.5 ms
102 ms: 1.45x slower
crypto_pyaes
54.0 ms
78.4 ms: 1.45x slower
scimark_sor
106 ms
156 ms: 1.48x slower
pprint_safe_repr
531 ms
796 ms: 1.50x slower
pprint_pformat
1.08 sec
1.62 sec: 1.50x slower
async_tree_eager_tg
48.4 ms
72.8 ms: 1.50x slower
regex_compile
78.5 ms
118 ms: 1.51x slower
richards
35.4 ms
53.7 ms: 1.51x slower
django_template
22.2 ms
34.1 ms: 1.54x slower
scimark_monte_carlo
50.4 ms
77.7 ms: 1.54x slower
go
115 ms
178 ms: 1.54x slower
sympy_str
145 ms
226 ms: 1.56x slower
bench_thread_pool
506 us
794 us: 1.57x slower
comprehensions
12.2 us
19.1 us: 1.57x slower
hexiom
4.85 ms
7.66 ms: 1.58x slower
richards_super
39.1 ms
61.9 ms: 1.58x slower
pickle_pure_python
213 us
338 us: 1.59x slower
logging_simple
3.57 us
5.70 us: 1.59x slower
unpickle_pure_python
163 us
261 us: 1.60x slower
logging_format
3.85 us
6.22 us: 1.61x slower
spectral_norm
77.3 ms
127 ms: 1.65x slower
float
56.2 ms
93.1 ms: 1.66x slower
sympy_expand
246 ms
415 ms: 1.68x slower
mako
7.68 ms
13.4 ms: 1.75x slower
sympy_sum
75.6 ms
136 ms: 1.80x slower
sqlglot_transpile
1.02 ms
1.84 ms: 1.80x slower
chaos
41.3 ms
75.1 ms: 1.82x slower
scimark_lu
76.5 ms
142 ms: 1.86x slower
logging_silent
69.9 ns
131 ns: 1.88x slower
sqlglot_parse
856 us
1.63 ms: 1.90x slower
raytrace
182 ms
357 ms: 1.97x slower
deltablue
2.68 ms
5.41 ms: 2.02x slower
nbody
73.9 ms
149 ms: 2.02x slower
Geometric mean
(ref)
1.30x slower
Benchmark hidden because not significant (1): async_tree_io_tg
Ignored benchmarks (15) of results/bm-20241007-3.13.0-60403a5/bm-20241007-darwin-arm64-python-v3.13.0-3.13.0-60403a5.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, sqlite_synth, unpack_sequence, unpickle, unpickle_list
Ignored benchmarks (3) of results/bm-20241026-3.14.0a1+-f6cc7c8-NOGIL/bm-20241026-darwin-arm64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json: sphinx, sqlalchemy_declarative, sqlalchemy_imperative
Reliability score: 100.00% likely to be slow
90% likely to have a slowdown of 1.19x
95% likely to have a slowdown of 1.18x
99% likely to have a slowdown of 1.16x