Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Fix wheels #763

Merged
merged 1 commit into from
Apr 25, 2024
Merged

[CI] Fix wheels #763

merged 1 commit into from
Apr 25, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Apr 25, 2024

No description provided.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 25, 2024
@vmoens vmoens added the CI label Apr 25, 2024
@vmoens vmoens merged commit 7dbb864 into main Apr 25, 2024
21 of 28 checks passed
@vmoens vmoens deleted the fix-wheels branch April 25, 2024 15:49
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 127. Improved: $\large\color{#35bf28}9$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 40.4050μs 16.7554μs 59.6824 KOps/s 60.2572 KOps/s $\color{#d91a1a}-0.95\%$
test_plain_set_stack_nested 43.3910μs 16.9696μs 58.9289 KOps/s 59.5387 KOps/s $\color{#d91a1a}-1.02\%$
test_plain_set_nested_inplace 72.9660μs 19.4409μs 51.4380 KOps/s 53.1526 KOps/s $\color{#d91a1a}-3.23\%$
test_plain_set_stack_nested_inplace 47.4680μs 19.2990μs 51.8163 KOps/s 53.0679 KOps/s $\color{#d91a1a}-2.36\%$
test_items 20.1280μs 2.5921μs 385.7850 KOps/s 382.0304 KOps/s $\color{#35bf28}+0.98\%$
test_items_nested 0.6162ms 0.2642ms 3.7850 KOps/s 3.7723 KOps/s $\color{#35bf28}+0.34\%$
test_items_nested_locked 0.8477ms 0.2669ms 3.7469 KOps/s 3.7568 KOps/s $\color{#d91a1a}-0.26\%$
test_items_nested_leaf 0.1445ms 76.7812μs 13.0240 KOps/s 13.2483 KOps/s $\color{#d91a1a}-1.69\%$
test_items_stack_nested 0.3942ms 0.2671ms 3.7433 KOps/s 3.7591 KOps/s $\color{#d91a1a}-0.42\%$
test_items_stack_nested_leaf 0.1716ms 78.5578μs 12.7295 KOps/s 12.7875 KOps/s $\color{#d91a1a}-0.45\%$
test_items_stack_nested_locked 0.3365ms 0.2665ms 3.7530 KOps/s 3.7266 KOps/s $\color{#35bf28}+0.71\%$
test_keys 20.6080μs 3.8152μs 262.1126 KOps/s 258.0532 KOps/s $\color{#35bf28}+1.57\%$
test_keys_nested 0.2523ms 0.1374ms 7.2762 KOps/s 7.3801 KOps/s $\color{#d91a1a}-1.41\%$
test_keys_nested_locked 1.9479ms 0.1447ms 6.9096 KOps/s 7.0053 KOps/s $\color{#d91a1a}-1.37\%$
test_keys_nested_leaf 0.2009ms 0.1181ms 8.4665 KOps/s 8.6478 KOps/s $\color{#d91a1a}-2.10\%$
test_keys_stack_nested 0.7888ms 0.1429ms 6.9967 KOps/s 7.2775 KOps/s $\color{#d91a1a}-3.86\%$
test_keys_stack_nested_leaf 0.2872ms 0.1185ms 8.4373 KOps/s 8.5575 KOps/s $\color{#d91a1a}-1.41\%$
test_keys_stack_nested_locked 0.1948ms 0.1437ms 6.9605 KOps/s 7.0180 KOps/s $\color{#d91a1a}-0.82\%$
test_values 18.8450μs 1.3288μs 752.5735 KOps/s 863.2790 KOps/s $\textbf{\color{#d91a1a}-12.82\%}$
test_values_nested 90.7200μs 51.4027μs 19.4542 KOps/s 19.8879 KOps/s $\color{#d91a1a}-2.18\%$
test_values_nested_locked 0.4929ms 51.1558μs 19.5481 KOps/s 19.8604 KOps/s $\color{#d91a1a}-1.57\%$
test_values_nested_leaf 0.3149ms 52.0176μs 19.2243 KOps/s 21.9988 KOps/s $\textbf{\color{#d91a1a}-12.61\%}$
test_values_stack_nested 94.8080μs 52.5595μs 19.0260 KOps/s 19.2612 KOps/s $\color{#d91a1a}-1.22\%$
test_values_stack_nested_leaf 0.1382ms 45.9836μs 21.7469 KOps/s 21.9615 KOps/s $\color{#d91a1a}-0.98\%$
test_values_stack_nested_locked 0.1679ms 51.9539μs 19.2478 KOps/s 19.5482 KOps/s $\color{#d91a1a}-1.54\%$
test_membership 20.2980μs 1.3575μs 736.6391 KOps/s 772.1956 KOps/s $\color{#d91a1a}-4.60\%$
test_membership_nested 29.7860μs 3.4123μs 293.0544 KOps/s 293.3436 KOps/s $\color{#d91a1a}-0.10\%$
test_membership_nested_leaf 32.2700μs 3.4345μs 291.1636 KOps/s 295.4763 KOps/s $\color{#d91a1a}-1.46\%$
test_membership_stacked_nested 28.9350μs 3.4194μs 292.4488 KOps/s 276.7461 KOps/s $\textbf{\color{#35bf28}+5.67\%}$
test_membership_stacked_nested_leaf 17.7830μs 3.4274μs 291.7695 KOps/s 289.6736 KOps/s $\color{#35bf28}+0.72\%$
test_membership_nested_last 25.1380μs 4.1635μs 240.1824 KOps/s 241.1043 KOps/s $\color{#d91a1a}-0.38\%$
test_membership_nested_leaf_last 18.1340μs 4.1996μs 238.1162 KOps/s 240.5656 KOps/s $\color{#d91a1a}-1.02\%$
test_membership_stacked_nested_last 31.9600μs 4.1916μs 238.5717 KOps/s 193.6063 KOps/s $\textbf{\color{#35bf28}+23.23\%}$
test_membership_stacked_nested_leaf_last 0.1607ms 4.2633μs 234.5609 KOps/s 191.1681 KOps/s $\textbf{\color{#35bf28}+22.70\%}$
test_nested_getleaf 93.9960μs 10.7463μs 93.0553 KOps/s 93.7661 KOps/s $\color{#d91a1a}-0.76\%$
test_nested_get 37.6500μs 10.2510μs 97.5512 KOps/s 99.3092 KOps/s $\color{#d91a1a}-1.77\%$
test_stacked_getleaf 44.0730μs 10.6365μs 94.0158 KOps/s 94.7255 KOps/s $\color{#d91a1a}-0.75\%$
test_stacked_get 26.4890μs 10.0957μs 99.0520 KOps/s 99.7844 KOps/s $\color{#d91a1a}-0.73\%$
test_nested_getitemleaf 0.1436ms 11.4194μs 87.5705 KOps/s 90.4304 KOps/s $\color{#d91a1a}-3.16\%$
test_nested_getitem 30.7480μs 10.5630μs 94.6698 KOps/s 97.2670 KOps/s $\color{#d91a1a}-2.67\%$
test_stacked_getitemleaf 30.2060μs 11.3940μs 87.7657 KOps/s 91.7911 KOps/s $\color{#d91a1a}-4.39\%$
test_stacked_getitem 33.2120μs 10.4512μs 95.6828 KOps/s 100.2291 KOps/s $\color{#d91a1a}-4.54\%$
test_lock_nested 50.4600ms 0.3934ms 2.5418 KOps/s 2.8961 KOps/s $\textbf{\color{#d91a1a}-12.23\%}$
test_lock_stack_nested 0.3920ms 0.3018ms 3.3136 KOps/s 3.2687 KOps/s $\color{#35bf28}+1.37\%$
test_unlock_nested 0.6631ms 0.3407ms 2.9352 KOps/s 2.5486 KOps/s $\textbf{\color{#35bf28}+15.17\%}$
test_unlock_stack_nested 0.4884ms 0.3099ms 3.2273 KOps/s 3.1803 KOps/s $\color{#35bf28}+1.48\%$
test_flatten_speed 0.2024ms 95.3731μs 10.4851 KOps/s 10.5135 KOps/s $\color{#d91a1a}-0.27\%$
test_unflatten_speed 0.7059ms 0.4106ms 2.4354 KOps/s 2.4642 KOps/s $\color{#d91a1a}-1.17\%$
test_common_ops 1.5111ms 0.7042ms 1.4201 KOps/s 1.4176 KOps/s $\color{#35bf28}+0.18\%$
test_creation 16.2300μs 1.9005μs 526.1647 KOps/s 534.9986 KOps/s $\color{#d91a1a}-1.65\%$
test_creation_empty 32.9720μs 10.6636μs 93.7769 KOps/s 96.9028 KOps/s $\color{#d91a1a}-3.23\%$
test_creation_nested_1 38.5320μs 13.3204μs 75.0731 KOps/s 77.3300 KOps/s $\color{#d91a1a}-2.92\%$
test_creation_nested_2 79.5120μs 16.7232μs 59.7970 KOps/s 60.9246 KOps/s $\color{#d91a1a}-1.85\%$
test_clone 60.5630μs 13.4617μs 74.2846 KOps/s 76.8699 KOps/s $\color{#d91a1a}-3.36\%$
test_getitem[int] 32.5010μs 11.4855μs 87.0666 KOps/s 86.3953 KOps/s $\color{#35bf28}+0.78\%$
test_getitem[slice_int] 57.5180μs 22.9490μs 43.5749 KOps/s 44.3856 KOps/s $\color{#d91a1a}-1.83\%$
test_getitem[range] 78.4960μs 59.1704μs 16.9003 KOps/s 16.9357 KOps/s $\color{#d91a1a}-0.21\%$
test_getitem[tuple] 46.1870μs 18.6169μs 53.7148 KOps/s 52.7945 KOps/s $\color{#35bf28}+1.74\%$
test_getitem[list] 0.1097ms 42.1100μs 23.7473 KOps/s 24.1612 KOps/s $\color{#d91a1a}-1.71\%$
test_setitem_dim[int] 67.9070μs 34.1998μs 29.2400 KOps/s 28.8960 KOps/s $\color{#35bf28}+1.19\%$
test_setitem_dim[slice_int] 0.1089ms 62.1866μs 16.0806 KOps/s 15.8827 KOps/s $\color{#35bf28}+1.25\%$
test_setitem_dim[range] 0.1370ms 84.1934μs 11.8774 KOps/s 11.6805 KOps/s $\color{#35bf28}+1.69\%$
test_setitem_dim[tuple] 99.0860μs 48.8701μs 20.4624 KOps/s 20.0181 KOps/s $\color{#35bf28}+2.22\%$
test_setitem 60.5840μs 20.0613μs 49.8471 KOps/s 50.9961 KOps/s $\color{#d91a1a}-2.25\%$
test_set 0.3746ms 19.6776μs 50.8192 KOps/s 52.5602 KOps/s $\color{#d91a1a}-3.31\%$
test_set_shared 3.9945ms 0.1415ms 7.0678 KOps/s 7.0699 KOps/s $\color{#d91a1a}-0.03\%$
test_update 0.1127ms 21.7243μs 46.0314 KOps/s 47.6072 KOps/s $\color{#d91a1a}-3.31\%$
test_update_nested 70.8520μs 29.7077μs 33.6613 KOps/s 34.5298 KOps/s $\color{#d91a1a}-2.52\%$
test_update__nested 0.1127ms 26.6684μs 37.4975 KOps/s 40.2415 KOps/s $\textbf{\color{#d91a1a}-6.82\%}$
test_set_nested 60.9740μs 21.7865μs 45.9000 KOps/s 48.4995 KOps/s $\textbf{\color{#d91a1a}-5.36\%}$
test_set_nested_new 93.9900μs 25.8933μs 38.6200 KOps/s 39.6365 KOps/s $\color{#d91a1a}-2.56\%$
test_select 88.6360μs 41.0130μs 24.3825 KOps/s 24.9986 KOps/s $\color{#d91a1a}-2.46\%$
test_select_nested 0.1192ms 62.0669μs 16.1117 KOps/s 16.7123 KOps/s $\color{#d91a1a}-3.59\%$
test_exclude_nested 0.2612ms 0.1213ms 8.2430 KOps/s 8.4230 KOps/s $\color{#d91a1a}-2.14\%$
test_empty[True] 0.7284ms 0.3994ms 2.5038 KOps/s 2.5543 KOps/s $\color{#d91a1a}-1.98\%$
test_empty[False] 5.2900μs 1.1029μs 906.7344 KOps/s 929.6481 KOps/s $\color{#d91a1a}-2.46\%$
test_unbind_speed 1.6124ms 0.2586ms 3.8671 KOps/s 3.9272 KOps/s $\color{#d91a1a}-1.53\%$
test_unbind_speed_stack0 0.4663ms 0.2477ms 4.0364 KOps/s 3.9813 KOps/s $\color{#35bf28}+1.38\%$
test_unbind_speed_stack1 65.5784ms 0.7001ms 1.4283 KOps/s 1.3209 KOps/s $\textbf{\color{#35bf28}+8.13\%}$
test_split 61.4414ms 1.5768ms 634.1974 Ops/s 615.4819 Ops/s $\color{#35bf28}+3.04\%$
test_chunk 66.4289ms 1.5690ms 637.3369 Ops/s 609.3225 Ops/s $\color{#35bf28}+4.60\%$
test_creation[device0] 3.5609ms 0.1052ms 9.5020 KOps/s 9.5501 KOps/s $\color{#d91a1a}-0.50\%$
test_creation_from_tensor 0.2220ms 84.1702μs 11.8807 KOps/s 12.0076 KOps/s $\color{#d91a1a}-1.06\%$
test_add_one[memmap_tensor0] 92.2130μs 5.3560μs 186.7061 KOps/s 185.8202 KOps/s $\color{#35bf28}+0.48\%$
test_contiguous[memmap_tensor0] 16.2910μs 0.6422μs 1.5572 MOps/s 1.6079 MOps/s $\color{#d91a1a}-3.15\%$
test_stack[memmap_tensor0] 18.5850μs 3.5076μs 285.0934 KOps/s 275.4858 KOps/s $\color{#35bf28}+3.49\%$
test_memmaptd_index 1.0004ms 0.2355ms 4.2466 KOps/s 4.0263 KOps/s $\textbf{\color{#35bf28}+5.47\%}$
test_memmaptd_index_astensor 0.7032ms 0.3077ms 3.2495 KOps/s 3.1303 KOps/s $\color{#35bf28}+3.81\%$
test_memmaptd_index_op 1.7794ms 0.6230ms 1.6051 KOps/s 1.6898 KOps/s $\textbf{\color{#d91a1a}-5.01\%}$
test_serialize_model 0.1657s 0.1113s 8.9859 Ops/s 8.8852 Ops/s $\color{#35bf28}+1.13\%$
test_serialize_model_pickle 0.4455s 0.3779s 2.6460 Ops/s 2.6385 Ops/s $\color{#35bf28}+0.28\%$
test_serialize_weights 0.1674s 0.1039s 9.6280 Ops/s 9.0348 Ops/s $\textbf{\color{#35bf28}+6.57\%}$
test_serialize_weights_returnearly 0.1423s 0.1250s 7.9970 Ops/s 7.6519 Ops/s $\color{#35bf28}+4.51\%$
test_serialize_weights_pickle 0.9968s 0.5862s 1.7059 Ops/s 2.3870 Ops/s $\textbf{\color{#d91a1a}-28.53\%}$
test_serialize_weights_filesystem 95.7015ms 90.9231ms 10.9983 Ops/s 11.0586 Ops/s $\color{#d91a1a}-0.55\%$
test_serialize_model_filesystem 0.1673s 0.1016s 9.8445 Ops/s 9.9655 Ops/s $\color{#d91a1a}-1.21\%$
test_reshape_pytree 61.7460μs 25.2709μs 39.5712 KOps/s 39.3697 KOps/s $\color{#35bf28}+0.51\%$
test_reshape_td 0.1038ms 32.8464μs 30.4447 KOps/s 29.9775 KOps/s $\color{#35bf28}+1.56\%$
test_view_pytree 56.8470μs 24.8527μs 40.2371 KOps/s 39.3687 KOps/s $\color{#35bf28}+2.21\%$
test_view_td 0.1044ms 37.8429μs 26.4251 KOps/s 26.4360 KOps/s $\color{#d91a1a}-0.04\%$
test_unbind_pytree 79.1590μs 29.1763μs 34.2744 KOps/s 34.4315 KOps/s $\color{#d91a1a}-0.46\%$
test_unbind_td 0.3724ms 37.9098μs 26.3784 KOps/s 26.5227 KOps/s $\color{#d91a1a}-0.54\%$
test_split_pytree 86.2910μs 29.0224μs 34.4561 KOps/s 34.4631 KOps/s $\color{#d91a1a}-0.02\%$
test_split_td 0.1249ms 40.6210μs 24.6178 KOps/s 24.2006 KOps/s $\color{#35bf28}+1.72\%$
test_add_pytree 75.8320μs 34.0415μs 29.3759 KOps/s 28.2504 KOps/s $\color{#35bf28}+3.98\%$
test_add_td 0.1521ms 55.4280μs 18.0414 KOps/s 18.2850 KOps/s $\color{#d91a1a}-1.33\%$
test_distributed 0.1821ms 98.6260μs 10.1393 KOps/s 9.8218 KOps/s $\color{#35bf28}+3.23\%$
test_tdmodule 47.1680μs 17.0029μs 58.8136 KOps/s 56.0114 KOps/s $\textbf{\color{#35bf28}+5.00\%}$
test_tdmodule_dispatch 68.2580μs 34.4573μs 29.0214 KOps/s 28.5829 KOps/s $\color{#35bf28}+1.53\%$
test_tdseq 48.9120μs 20.1883μs 49.5336 KOps/s 47.9825 KOps/s $\color{#35bf28}+3.23\%$
test_tdseq_dispatch 56.5660μs 39.2466μs 25.4799 KOps/s 24.7724 KOps/s $\color{#35bf28}+2.86\%$
test_instantiation_functorch 2.1411ms 1.3397ms 746.4318 Ops/s 753.5820 Ops/s $\color{#d91a1a}-0.95\%$
test_instantiation_td 1.6577ms 1.0238ms 976.7442 Ops/s 978.3652 Ops/s $\color{#d91a1a}-0.17\%$
test_exec_functorch 0.2955ms 0.1579ms 6.3323 KOps/s 6.2031 KOps/s $\color{#35bf28}+2.08\%$
test_exec_functional_call 0.2808ms 0.1441ms 6.9407 KOps/s 6.5818 KOps/s $\textbf{\color{#35bf28}+5.45\%}$
test_exec_td 0.2830ms 0.1422ms 7.0315 KOps/s 6.8507 KOps/s $\color{#35bf28}+2.64\%$
test_exec_td_decorator 0.8245ms 0.2207ms 4.5319 KOps/s 4.4857 KOps/s $\color{#35bf28}+1.03\%$
test_vmap_mlp_speed[True-True] 0.8914ms 0.4857ms 2.0588 KOps/s 2.0575 KOps/s $\color{#35bf28}+0.06\%$
test_vmap_mlp_speed[True-False] 0.7204ms 0.4835ms 2.0684 KOps/s 2.0634 KOps/s $\color{#35bf28}+0.24\%$
test_vmap_mlp_speed[False-True] 0.6667ms 0.3936ms 2.5407 KOps/s 2.5508 KOps/s $\color{#d91a1a}-0.40\%$
test_vmap_mlp_speed[False-False] 0.8079ms 0.4052ms 2.4681 KOps/s 2.5472 KOps/s $\color{#d91a1a}-3.10\%$
test_vmap_mlp_speed_decorator[True-True] 0.7521ms 0.5526ms 1.8095 KOps/s 1.8015 KOps/s $\color{#35bf28}+0.44\%$
test_vmap_mlp_speed_decorator[True-False] 0.7808ms 0.5519ms 1.8118 KOps/s 1.8173 KOps/s $\color{#d91a1a}-0.30\%$
test_vmap_mlp_speed_decorator[False-True] 0.7157ms 0.4526ms 2.2093 KOps/s 2.1897 KOps/s $\color{#35bf28}+0.90\%$
test_vmap_mlp_speed_decorator[False-False] 0.9521ms 0.4796ms 2.0851 KOps/s 2.1956 KOps/s $\textbf{\color{#d91a1a}-5.03\%}$
test_to_module_speed[True] 1.9135ms 1.6815ms 594.7135 Ops/s 593.3700 Ops/s $\color{#35bf28}+0.23\%$
test_to_module_speed[False] 2.3033ms 1.6457ms 607.6334 Ops/s 602.1350 Ops/s $\color{#35bf28}+0.91\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants