Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Remove all osx x86 workflows #760

Merged
merged 1 commit into from
Apr 25, 2024
Merged

[CI] Remove all osx x86 workflows #760

merged 1 commit into from
Apr 25, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Apr 25, 2024

Follow up on #753

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 25, 2024
@vmoens vmoens added the CI label Apr 25, 2024
@vmoens vmoens merged commit e7e1f50 into main Apr 25, 2024
16 of 21 checks passed
@vmoens vmoens deleted the remove-all-osx-x86 branch April 25, 2024 14:24
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 127. Improved: $\large\color{#35bf28}9$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 35.0960μs 16.9100μs 59.1368 KOps/s 60.8317 KOps/s $\color{#d91a1a}-2.79\%$
test_plain_set_stack_nested 61.5160μs 17.1214μs 58.4064 KOps/s 60.5688 KOps/s $\color{#d91a1a}-3.57\%$
test_plain_set_nested_inplace 0.1315ms 19.3572μs 51.6603 KOps/s 53.4456 KOps/s $\color{#d91a1a}-3.34\%$
test_plain_set_stack_nested_inplace 53.3590μs 19.3960μs 51.5570 KOps/s 53.4483 KOps/s $\color{#d91a1a}-3.54\%$
test_items 25.2480μs 2.5765μs 388.1216 KOps/s 391.6615 KOps/s $\color{#d91a1a}-0.90\%$
test_items_nested 0.4934ms 0.2676ms 3.7375 KOps/s 3.7519 KOps/s $\color{#d91a1a}-0.38\%$
test_items_nested_locked 0.8739ms 0.2693ms 3.7137 KOps/s 3.7545 KOps/s $\color{#d91a1a}-1.09\%$
test_items_nested_leaf 0.1387ms 77.7894μs 12.8552 KOps/s 13.0775 KOps/s $\color{#d91a1a}-1.70\%$
test_items_stack_nested 0.5125ms 0.2676ms 3.7368 KOps/s 3.7129 KOps/s $\color{#35bf28}+0.64\%$
test_items_stack_nested_leaf 0.2091ms 77.2298μs 12.9484 KOps/s 13.3219 KOps/s $\color{#d91a1a}-2.80\%$
test_items_stack_nested_locked 0.3570ms 0.2697ms 3.7076 KOps/s 3.7099 KOps/s $\color{#d91a1a}-0.06\%$
test_keys 31.8290μs 3.9998μs 250.0150 KOps/s 249.3344 KOps/s $\color{#35bf28}+0.27\%$
test_keys_nested 0.2619ms 0.1412ms 7.0823 KOps/s 7.3391 KOps/s $\color{#d91a1a}-3.50\%$
test_keys_nested_locked 1.9615ms 0.1450ms 6.8977 KOps/s 6.7822 KOps/s $\color{#35bf28}+1.70\%$
test_keys_nested_leaf 0.2051ms 0.1188ms 8.4180 KOps/s 8.6310 KOps/s $\color{#d91a1a}-2.47\%$
test_keys_stack_nested 0.2341ms 0.1422ms 7.0319 KOps/s 7.4084 KOps/s $\textbf{\color{#d91a1a}-5.08\%}$
test_keys_stack_nested_leaf 0.2168ms 0.1205ms 8.3019 KOps/s 8.7018 KOps/s $\color{#d91a1a}-4.60\%$
test_keys_stack_nested_locked 0.2399ms 0.1465ms 6.8259 KOps/s 7.1885 KOps/s $\textbf{\color{#d91a1a}-5.04\%}$
test_values 10.1690μs 1.1809μs 846.8426 KOps/s 863.2481 KOps/s $\color{#d91a1a}-1.90\%$
test_values_nested 90.9600μs 52.1524μs 19.1746 KOps/s 19.7750 KOps/s $\color{#d91a1a}-3.04\%$
test_values_nested_locked 0.1158ms 51.7428μs 19.3264 KOps/s 19.9504 KOps/s $\color{#d91a1a}-3.13\%$
test_values_nested_leaf 96.7010μs 46.5799μs 21.4685 KOps/s 21.7757 KOps/s $\color{#d91a1a}-1.41\%$
test_values_stack_nested 0.1018ms 51.2193μs 19.5239 KOps/s 19.4627 KOps/s $\color{#35bf28}+0.31\%$
test_values_stack_nested_leaf 92.2330μs 46.8365μs 21.3509 KOps/s 22.2101 KOps/s $\color{#d91a1a}-3.87\%$
test_values_stack_nested_locked 0.1062ms 51.4277μs 19.4448 KOps/s 19.2820 KOps/s $\color{#35bf28}+0.84\%$
test_membership 33.6830μs 1.3763μs 726.5889 KOps/s 732.0694 KOps/s $\color{#d91a1a}-0.75\%$
test_membership_nested 50.3440μs 3.5064μs 285.1922 KOps/s 291.1195 KOps/s $\color{#d91a1a}-2.04\%$
test_membership_nested_leaf 27.1710μs 3.5279μs 283.4554 KOps/s 291.1044 KOps/s $\color{#d91a1a}-2.63\%$
test_membership_stacked_nested 26.8900μs 3.4802μs 287.3432 KOps/s 290.6030 KOps/s $\color{#d91a1a}-1.12\%$
test_membership_stacked_nested_leaf 53.6910μs 3.4990μs 285.7997 KOps/s 245.3174 KOps/s $\textbf{\color{#35bf28}+16.50\%}$
test_membership_nested_last 40.4250μs 4.2424μs 235.7134 KOps/s 239.4150 KOps/s $\color{#d91a1a}-1.55\%$
test_membership_nested_leaf_last 50.7950μs 4.2918μs 233.0006 KOps/s 241.1845 KOps/s $\color{#d91a1a}-3.39\%$
test_membership_stacked_nested_last 31.3490μs 4.2393μs 235.8894 KOps/s 76.5308 KOps/s $\textbf{\color{#35bf28}+208.23\%}$
test_membership_stacked_nested_leaf_last 47.3180μs 4.2627μs 234.5935 KOps/s 76.7057 KOps/s $\textbf{\color{#35bf28}+205.84\%}$
test_nested_getleaf 34.2240μs 10.5133μs 95.1175 KOps/s 95.4496 KOps/s $\color{#d91a1a}-0.35\%$
test_nested_get 41.6280μs 10.0202μs 99.7985 KOps/s 100.4684 KOps/s $\color{#d91a1a}-0.67\%$
test_stacked_getleaf 46.2660μs 10.5697μs 94.6097 KOps/s 94.9037 KOps/s $\color{#d91a1a}-0.31\%$
test_stacked_get 44.4730μs 10.0005μs 99.9948 KOps/s 101.4669 KOps/s $\color{#d91a1a}-1.45\%$
test_nested_getitemleaf 37.7510μs 11.2206μs 89.1217 KOps/s 89.7866 KOps/s $\color{#d91a1a}-0.74\%$
test_nested_getitem 46.4970μs 10.3130μs 96.9646 KOps/s 97.3780 KOps/s $\color{#d91a1a}-0.42\%$
test_stacked_getitemleaf 44.2230μs 11.0508μs 90.4915 KOps/s 89.5269 KOps/s $\color{#35bf28}+1.08\%$
test_stacked_getitem 34.0440μs 10.3098μs 96.9951 KOps/s 98.9767 KOps/s $\color{#d91a1a}-2.00\%$
test_lock_nested 49.3400ms 0.4061ms 2.4627 KOps/s 2.7829 KOps/s $\textbf{\color{#d91a1a}-11.51\%}$
test_lock_stack_nested 0.6103ms 0.3129ms 3.1956 KOps/s 3.3257 KOps/s $\color{#d91a1a}-3.91\%$
test_unlock_nested 0.6759ms 0.3488ms 2.8673 KOps/s 2.4868 KOps/s $\textbf{\color{#35bf28}+15.30\%}$
test_unlock_stack_nested 0.4584ms 0.3200ms 3.1251 KOps/s 3.2355 KOps/s $\color{#d91a1a}-3.41\%$
test_flatten_speed 0.1851ms 96.0591μs 10.4103 KOps/s 10.4348 KOps/s $\color{#d91a1a}-0.24\%$
test_unflatten_speed 1.9018ms 0.4230ms 2.3641 KOps/s 2.4766 KOps/s $\color{#d91a1a}-4.54\%$
test_common_ops 1.4377ms 0.7227ms 1.3837 KOps/s 1.4269 KOps/s $\color{#d91a1a}-3.03\%$
test_creation 67.2770μs 1.8937μs 528.0611 KOps/s 520.8624 KOps/s $\color{#35bf28}+1.38\%$
test_creation_empty 43.5010μs 10.4512μs 95.6827 KOps/s 101.0426 KOps/s $\textbf{\color{#d91a1a}-5.30\%}$
test_creation_nested_1 52.2080μs 13.2017μs 75.7475 KOps/s 79.7361 KOps/s $\textbf{\color{#d91a1a}-5.00\%}$
test_creation_nested_2 44.8440μs 16.6229μs 60.1580 KOps/s 62.6637 KOps/s $\color{#d91a1a}-4.00\%$
test_clone 82.8450μs 13.6751μs 73.1255 KOps/s 72.1772 KOps/s $\color{#35bf28}+1.31\%$
test_getitem[int] 49.1720μs 11.6365μs 85.9367 KOps/s 86.0068 KOps/s $\color{#d91a1a}-0.08\%$
test_getitem[slice_int] 55.7350μs 22.7476μs 43.9606 KOps/s 43.6072 KOps/s $\color{#35bf28}+0.81\%$
test_getitem[range] 78.8670μs 58.5234μs 17.0872 KOps/s 16.6433 KOps/s $\color{#35bf28}+2.67\%$
test_getitem[tuple] 57.8480μs 18.4582μs 54.1764 KOps/s 51.9341 KOps/s $\color{#35bf28}+4.32\%$
test_getitem[list] 0.2347ms 40.4610μs 24.7152 KOps/s 24.1742 KOps/s $\color{#35bf28}+2.24\%$
test_setitem_dim[int] 63.5190μs 34.6838μs 28.8319 KOps/s 29.4054 KOps/s $\color{#d91a1a}-1.95\%$
test_setitem_dim[slice_int] 0.1096ms 62.0601μs 16.1134 KOps/s 16.2000 KOps/s $\color{#d91a1a}-0.53\%$
test_setitem_dim[range] 0.1463ms 83.7859μs 11.9352 KOps/s 12.2538 KOps/s $\color{#d91a1a}-2.60\%$
test_setitem_dim[tuple] 79.2690μs 49.7347μs 20.1067 KOps/s 20.3473 KOps/s $\color{#d91a1a}-1.18\%$
test_setitem 67.4560μs 20.1013μs 49.7481 KOps/s 50.2282 KOps/s $\color{#d91a1a}-0.96\%$
test_set 69.8610μs 19.8435μs 50.3944 KOps/s 51.4350 KOps/s $\color{#d91a1a}-2.02\%$
test_set_shared 4.6230ms 0.1458ms 6.8574 KOps/s 6.8594 KOps/s $\color{#d91a1a}-0.03\%$
test_update 92.8540μs 21.3821μs 46.7680 KOps/s 47.1436 KOps/s $\color{#d91a1a}-0.80\%$
test_update_nested 75.1500μs 29.9742μs 33.3620 KOps/s 33.8097 KOps/s $\color{#d91a1a}-1.32\%$
test_update__nested 0.1096ms 25.4294μs 39.3245 KOps/s 39.5664 KOps/s $\color{#d91a1a}-0.61\%$
test_set_nested 66.8050μs 21.4874μs 46.5390 KOps/s 46.8452 KOps/s $\color{#d91a1a}-0.65\%$
test_set_nested_new 68.5980μs 25.0862μs 39.8626 KOps/s 39.8993 KOps/s $\color{#d91a1a}-0.09\%$
test_select 0.1041ms 39.7284μs 25.1709 KOps/s 24.1312 KOps/s $\color{#35bf28}+4.31\%$
test_select_nested 0.1328ms 60.9895μs 16.3963 KOps/s 15.7654 KOps/s $\color{#35bf28}+4.00\%$
test_exclude_nested 0.2209ms 0.1220ms 8.1982 KOps/s 8.2861 KOps/s $\color{#d91a1a}-1.06\%$
test_empty[True] 0.7108ms 0.3974ms 2.5162 KOps/s 2.5355 KOps/s $\color{#d91a1a}-0.76\%$
test_empty[False] 7.8026μs 1.0837μs 922.8030 KOps/s 862.5216 KOps/s $\textbf{\color{#35bf28}+6.99\%}$
test_unbind_speed 0.3270ms 0.2578ms 3.8785 KOps/s 3.6617 KOps/s $\textbf{\color{#35bf28}+5.92\%}$
test_unbind_speed_stack0 1.2163ms 0.2759ms 3.6241 KOps/s 3.9977 KOps/s $\textbf{\color{#d91a1a}-9.34\%}$
test_unbind_speed_stack1 63.6247ms 0.7264ms 1.3767 KOps/s 1.3181 KOps/s $\color{#35bf28}+4.44\%$
test_split 61.0915ms 1.5916ms 628.3151 Ops/s 613.7813 Ops/s $\color{#35bf28}+2.37\%$
test_chunk 65.1998ms 1.5805ms 632.7194 Ops/s 615.6272 Ops/s $\color{#35bf28}+2.78\%$
test_creation[device0] 0.1671ms 0.1041ms 9.6049 KOps/s 9.5675 KOps/s $\color{#35bf28}+0.39\%$
test_creation_from_tensor 3.5835ms 83.4219μs 11.9873 KOps/s 11.9247 KOps/s $\color{#35bf28}+0.52\%$
test_add_one[memmap_tensor0] 61.7450μs 5.3304μs 187.6025 KOps/s 182.9651 KOps/s $\color{#35bf28}+2.53\%$
test_contiguous[memmap_tensor0] 11.4720μs 0.6387μs 1.5657 MOps/s 1.4882 MOps/s $\textbf{\color{#35bf28}+5.21\%}$
test_stack[memmap_tensor0] 33.8330μs 3.5197μs 284.1120 KOps/s 281.9979 KOps/s $\color{#35bf28}+0.75\%$
test_memmaptd_index 0.9736ms 0.2377ms 4.2063 KOps/s 4.0874 KOps/s $\color{#35bf28}+2.91\%$
test_memmaptd_index_astensor 0.7705ms 0.3147ms 3.1775 KOps/s 3.2030 KOps/s $\color{#d91a1a}-0.80\%$
test_memmaptd_index_op 1.0459ms 0.5932ms 1.6858 KOps/s 1.6845 KOps/s $\color{#35bf28}+0.08\%$
test_serialize_model 0.1110s 0.1031s 9.6962 Ops/s 8.5861 Ops/s $\textbf{\color{#35bf28}+12.93\%}$
test_serialize_model_pickle 0.4471s 0.3797s 2.6339 Ops/s 2.6361 Ops/s $\color{#d91a1a}-0.09\%$
test_serialize_weights 0.1635s 0.1064s 9.3991 Ops/s 9.1360 Ops/s $\color{#35bf28}+2.88\%$
test_serialize_weights_returnearly 0.1879s 0.1336s 7.4837 Ops/s 7.2737 Ops/s $\color{#35bf28}+2.89\%$
test_serialize_weights_pickle 0.9567s 0.5782s 1.7294 Ops/s 1.5394 Ops/s $\textbf{\color{#35bf28}+12.34\%}$
test_serialize_weights_filesystem 0.1544s 96.7272ms 10.3384 Ops/s 10.5208 Ops/s $\color{#d91a1a}-1.73\%$
test_serialize_model_filesystem 99.7546ms 93.1347ms 10.7371 Ops/s 10.7788 Ops/s $\color{#d91a1a}-0.39\%$
test_reshape_pytree 69.6200μs 25.7834μs 38.7846 KOps/s 40.0906 KOps/s $\color{#d91a1a}-3.26\%$
test_reshape_td 77.3350μs 33.9817μs 29.4276 KOps/s 30.0502 KOps/s $\color{#d91a1a}-2.07\%$
test_view_pytree 59.6420μs 25.2819μs 39.5539 KOps/s 39.9203 KOps/s $\color{#d91a1a}-0.92\%$
test_view_td 99.0460μs 37.1171μs 26.9418 KOps/s 27.1463 KOps/s $\color{#d91a1a}-0.75\%$
test_unbind_pytree 78.9380μs 29.5297μs 33.8642 KOps/s 34.1528 KOps/s $\color{#d91a1a}-0.85\%$
test_unbind_td 0.3617ms 38.6702μs 25.8597 KOps/s 25.8504 KOps/s $\color{#35bf28}+0.04\%$
test_split_pytree 87.6140μs 29.4317μs 33.9770 KOps/s 34.4240 KOps/s $\color{#d91a1a}-1.30\%$
test_split_td 0.4890ms 41.3511μs 24.1832 KOps/s 24.4292 KOps/s $\color{#d91a1a}-1.01\%$
test_add_pytree 72.9360μs 34.8792μs 28.6704 KOps/s 28.6999 KOps/s $\color{#d91a1a}-0.10\%$
test_add_td 0.1588ms 54.9721μs 18.1910 KOps/s 18.7881 KOps/s $\color{#d91a1a}-3.18\%$
test_distributed 0.1774ms 99.2437μs 10.0762 KOps/s 9.7270 KOps/s $\color{#35bf28}+3.59\%$
test_tdmodule 66.3240μs 17.4444μs 57.3251 KOps/s 57.8436 KOps/s $\color{#d91a1a}-0.90\%$
test_tdmodule_dispatch 51.6070μs 34.6675μs 28.8455 KOps/s 29.1258 KOps/s $\color{#d91a1a}-0.96\%$
test_tdseq 49.7830μs 20.5550μs 48.6499 KOps/s 48.3479 KOps/s $\color{#35bf28}+0.62\%$
test_tdseq_dispatch 81.4520μs 39.7600μs 25.1509 KOps/s 25.2423 KOps/s $\color{#d91a1a}-0.36\%$
test_instantiation_functorch 2.0215ms 1.3234ms 755.6528 Ops/s 752.2425 Ops/s $\color{#35bf28}+0.45\%$
test_instantiation_td 71.4242ms 1.1388ms 878.1130 Ops/s 908.7302 Ops/s $\color{#d91a1a}-3.37\%$
test_exec_functorch 0.3013ms 0.1620ms 6.1744 KOps/s 6.1809 KOps/s $\color{#d91a1a}-0.11\%$
test_exec_functional_call 0.2823ms 0.1490ms 6.7115 KOps/s 6.6434 KOps/s $\color{#35bf28}+1.03\%$
test_exec_td 0.2762ms 0.1429ms 6.9982 KOps/s 6.7040 KOps/s $\color{#35bf28}+4.39\%$
test_exec_td_decorator 0.8470ms 0.2205ms 4.5360 KOps/s 4.4626 KOps/s $\color{#35bf28}+1.64\%$
test_vmap_mlp_speed[True-True] 0.7450ms 0.4865ms 2.0554 KOps/s 2.0459 KOps/s $\color{#35bf28}+0.47\%$
test_vmap_mlp_speed[True-False] 0.7000ms 0.4824ms 2.0729 KOps/s 2.0502 KOps/s $\color{#35bf28}+1.11\%$
test_vmap_mlp_speed[False-True] 0.5997ms 0.3962ms 2.5242 KOps/s 2.5135 KOps/s $\color{#35bf28}+0.43\%$
test_vmap_mlp_speed[False-False] 0.7337ms 0.3960ms 2.5251 KOps/s 2.4801 KOps/s $\color{#35bf28}+1.82\%$
test_vmap_mlp_speed_decorator[True-True] 1.0401ms 0.5580ms 1.7921 KOps/s 1.7787 KOps/s $\color{#35bf28}+0.75\%$
test_vmap_mlp_speed_decorator[True-False] 0.8403ms 0.5541ms 1.8048 KOps/s 1.7774 KOps/s $\color{#35bf28}+1.54\%$
test_vmap_mlp_speed_decorator[False-True] 0.9060ms 0.4582ms 2.1824 KOps/s 2.1747 KOps/s $\color{#35bf28}+0.35\%$
test_vmap_mlp_speed_decorator[False-False] 0.7159ms 0.4554ms 2.1960 KOps/s 2.1703 KOps/s $\color{#35bf28}+1.19\%$
test_to_module_speed[True] 2.2604ms 1.6698ms 598.8657 Ops/s 599.9440 Ops/s $\color{#d91a1a}-0.18\%$
test_to_module_speed[False] 2.5245ms 1.6536ms 604.7523 Ops/s 611.3905 Ops/s $\color{#d91a1a}-1.09\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants