Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] Disable compile tests on windows #2510

Merged
merged 1 commit into from
Oct 21, 2024
Merged

[CI] Disable compile tests on windows #2510

merged 1 commit into from
Oct 21, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Oct 21, 2024 •
edited
Loading

Stack from ghstack (oldest at bottom):

@vmoens
Update
ee9f67d 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Oct 21, 2024
@vmoens
[CI] Disable compile tests on windows
997ab3c 
ghstack-source-id: 49737ccee6bc1e520591ad7210f830e80257a222
Pull Request resolved: #2510
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Oct 21, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2510

Note: Links to docs will display an error until the docs builds have been completed.

❌ 18 New Failures, 4 Unrelated Failures

As of commit ee9f67d with merge base 56b0b9a (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 21, 2024
@vmoens vmoens merged commit ee9f67d into gh/vmoens/35/base Oct 21, 2024
15 of 25 checks passed
vmoens added a commit that referenced this pull request Oct 21, 2024
@vmoens
[CI] Disable compile tests on windows
ae77208 
ghstack-source-id: 49737ccee6bc1e520591ad7210f830e80257a222
Pull Request resolved: #2510
@vmoens vmoens deleted the gh/vmoens/35/head branch October 21, 2024 14:21
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 143. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.4234s 0.4196s 2.3831 Ops/s 2.3655 Ops/s $\color{#35bf28}+0.74\%$
test_transformed 0.6928s 0.6136s 1.6298 Ops/s 1.7426 Ops/s $\textbf{\color{#d91a1a}-6.47\%}$
test_serial 1.4311s 1.3509s 0.7403 Ops/s 0.7568 Ops/s $\color{#d91a1a}-2.19\%$
test_parallel 1.3946s 1.3198s 0.7577 Ops/s 0.7530 Ops/s $\color{#35bf28}+0.62\%$
test_step_mdp_speed[True-True-True-True-True] 0.1944ms 28.9076μs 34.5930 KOps/s 34.4124 KOps/s $\color{#35bf28}+0.52\%$
test_step_mdp_speed[True-True-True-True-False] 46.6980μs 17.3645μs 57.5889 KOps/s 57.4870 KOps/s $\color{#35bf28}+0.18\%$
test_step_mdp_speed[True-True-True-False-True] 61.6350μs 16.1222μs 62.0263 KOps/s 61.9392 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[True-True-True-False-False] 40.0450μs 9.5793μs 104.3920 KOps/s 102.8471 KOps/s $\color{#35bf28}+1.50\%$
test_step_mdp_speed[True-True-False-True-True] 75.3110μs 31.5404μs 31.7053 KOps/s 31.8858 KOps/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-True-False-True-False] 59.7420μs 19.6293μs 50.9442 KOps/s 52.1481 KOps/s $\color{#d91a1a}-2.31\%$
test_step_mdp_speed[True-True-False-False-True] 63.5390μs 18.2866μs 54.6850 KOps/s 54.6382 KOps/s $\color{#35bf28}+0.09\%$
test_step_mdp_speed[True-True-False-False-False] 49.5930μs 11.7250μs 85.2875 KOps/s 84.6194 KOps/s $\color{#35bf28}+0.79\%$
test_step_mdp_speed[True-False-True-True-True] 67.3960μs 33.6147μs 29.7489 KOps/s 30.0463 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[True-False-True-True-False] 65.7330μs 21.9774μs 45.5013 KOps/s 45.7512 KOps/s $\color{#d91a1a}-0.55\%$
test_step_mdp_speed[True-False-True-False-True] 52.1580μs 18.2149μs 54.9001 KOps/s 54.2479 KOps/s $\color{#35bf28}+1.20\%$
test_step_mdp_speed[True-False-True-False-False] 49.5130μs 11.5848μs 86.3199 KOps/s 85.2074 KOps/s $\color{#35bf28}+1.31\%$
test_step_mdp_speed[True-False-False-True-True] 91.2110μs 35.2158μs 28.3963 KOps/s 27.0481 KOps/s $\color{#35bf28}+4.98\%$
test_step_mdp_speed[True-False-False-True-False] 66.6850μs 23.8058μs 42.0066 KOps/s 41.7611 KOps/s $\color{#35bf28}+0.59\%$
test_step_mdp_speed[True-False-False-False-True] 49.6630μs 20.3137μs 49.2279 KOps/s 48.9926 KOps/s $\color{#35bf28}+0.48\%$
test_step_mdp_speed[True-False-False-False-False] 53.5710μs 13.6998μs 72.9937 KOps/s 71.9308 KOps/s $\color{#35bf28}+1.48\%$
test_step_mdp_speed[False-True-True-True-True] 75.3210μs 33.3817μs 29.9565 KOps/s 29.7261 KOps/s $\color{#35bf28}+0.78\%$
test_step_mdp_speed[False-True-True-True-False] 52.8390μs 21.8241μs 45.8209 KOps/s 45.8684 KOps/s $\color{#d91a1a}-0.10\%$
test_step_mdp_speed[False-True-True-False-True] 60.2130μs 21.5244μs 46.4590 KOps/s 46.1750 KOps/s $\color{#35bf28}+0.62\%$
test_step_mdp_speed[False-True-True-False-False] 43.6420μs 13.3523μs 74.8936 KOps/s 73.9463 KOps/s $\color{#35bf28}+1.28\%$
test_step_mdp_speed[False-True-False-True-True] 0.1160ms 35.5142μs 28.1577 KOps/s 27.9515 KOps/s $\color{#35bf28}+0.74\%$
test_step_mdp_speed[False-True-False-True-False] 64.6110μs 23.6721μs 42.2438 KOps/s 42.1996 KOps/s $\color{#35bf28}+0.10\%$
test_step_mdp_speed[False-True-False-False-True] 2.9420ms 23.3959μs 42.7425 KOps/s 42.6610 KOps/s $\color{#35bf28}+0.19\%$
test_step_mdp_speed[False-True-False-False-False] 37.3900μs 15.3499μs 65.1469 KOps/s 63.7625 KOps/s $\color{#35bf28}+2.17\%$
test_step_mdp_speed[False-False-True-True-True] 94.3950μs 37.2825μs 26.8222 KOps/s 26.5985 KOps/s $\color{#35bf28}+0.84\%$
test_step_mdp_speed[False-False-True-True-False] 52.2270μs 25.8453μs 38.6918 KOps/s 38.5384 KOps/s $\color{#35bf28}+0.40\%$
test_step_mdp_speed[False-False-True-False-True] 55.0540μs 23.6219μs 42.3337 KOps/s 42.9893 KOps/s $\color{#d91a1a}-1.53\%$
test_step_mdp_speed[False-False-True-False-False] 97.9560μs 15.2274μs 65.6711 KOps/s 63.7976 KOps/s $\color{#35bf28}+2.94\%$
test_step_mdp_speed[False-False-False-True-True] 85.1690μs 39.2314μs 25.4898 KOps/s 25.4171 KOps/s $\color{#35bf28}+0.29\%$
test_step_mdp_speed[False-False-False-True-False] 71.3650μs 27.6744μs 36.1345 KOps/s 35.8117 KOps/s $\color{#35bf28}+0.90\%$
test_step_mdp_speed[False-False-False-False-True] 50.7450μs 25.1555μs 39.7527 KOps/s 39.6950 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[False-False-False-False-False] 52.4080μs 17.4764μs 57.2201 KOps/s 57.5273 KOps/s $\color{#d91a1a}-0.53\%$
test_values[generalized_advantage_estimate-True-True] 10.0396ms 9.4345ms 105.9941 Ops/s 108.0663 Ops/s $\color{#d91a1a}-1.92\%$
test_values[vec_generalized_advantage_estimate-True-True] 37.9562ms 34.2040ms 29.2364 Ops/s 29.8803 Ops/s $\color{#d91a1a}-2.16\%$
test_values[td0_return_estimate-False-False] 0.2267ms 0.1750ms 5.7139 KOps/s 5.8819 KOps/s $\color{#d91a1a}-2.86\%$
test_values[td1_return_estimate-False-False] 31.5326ms 23.8325ms 41.9595 Ops/s 42.5691 Ops/s $\color{#d91a1a}-1.43\%$
test_values[vec_td1_return_estimate-False-False] 38.1798ms 34.6959ms 28.8219 Ops/s 29.6750 Ops/s $\color{#d91a1a}-2.88\%$
test_values[td_lambda_return_estimate-True-False] 34.8090ms 33.9693ms 29.4383 Ops/s 29.9664 Ops/s $\color{#d91a1a}-1.76\%$
test_values[vec_td_lambda_return_estimate-True-False] 38.3878ms 33.9167ms 29.4840 Ops/s 29.7567 Ops/s $\color{#d91a1a}-0.92\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 13.5067ms 8.4555ms 118.2668 Ops/s 121.9600 Ops/s $\color{#d91a1a}-3.03\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3372ms 1.9781ms 505.5451 Ops/s 500.8030 Ops/s $\color{#35bf28}+0.95\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4495ms 0.3602ms 2.7763 KOps/s 2.8328 KOps/s $\color{#d91a1a}-1.99\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 46.9424ms 43.0958ms 23.2041 Ops/s 24.0597 Ops/s $\color{#d91a1a}-3.56\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.8888ms 3.0452ms 328.3840 Ops/s 321.2037 Ops/s $\color{#35bf28}+2.24\%$
test_dqn_speed[False-None] 5.5653ms 1.3896ms 719.6073 Ops/s 739.7405 Ops/s $\color{#d91a1a}-2.72\%$
test_dqn_speed[False-backward] 2.0210ms 1.8480ms 541.1139 Ops/s 536.7925 Ops/s $\color{#35bf28}+0.81\%$
test_dqn_speed[True-None] 0.8017ms 0.4695ms 2.1299 KOps/s 2.1709 KOps/s $\color{#d91a1a}-1.89\%$
test_dqn_speed[True-backward] 0.9303ms 0.8843ms 1.1309 KOps/s 1.1396 KOps/s $\color{#d91a1a}-0.76\%$
test_dqn_speed[reduce-overhead-None] 0.7721ms 0.4775ms 2.0942 KOps/s 2.1386 KOps/s $\color{#d91a1a}-2.08\%$
test_dqn_speed[reduce-overhead-backward] 0.9821ms 0.8898ms 1.1238 KOps/s 1.1326 KOps/s $\color{#d91a1a}-0.78\%$
test_ddpg_speed[False-None] 3.5300ms 2.8486ms 351.0503 Ops/s 356.0093 Ops/s $\color{#d91a1a}-1.39\%$
test_ddpg_speed[False-backward] 4.8439ms 4.0003ms 249.9786 Ops/s 254.6160 Ops/s $\color{#d91a1a}-1.82\%$
test_ddpg_speed[True-None] 1.4336ms 1.0161ms 984.1312 Ops/s 1.0017 KOps/s $\color{#d91a1a}-1.75\%$
test_ddpg_speed[True-backward] 2.5171ms 1.9649ms 508.9254 Ops/s 525.3552 Ops/s $\color{#d91a1a}-3.13\%$
test_ddpg_speed[reduce-overhead-None] 1.4640ms 1.0171ms 983.1625 Ops/s 995.7506 Ops/s $\color{#d91a1a}-1.26\%$
test_ddpg_speed[reduce-overhead-backward] 1.9878ms 1.9146ms 522.3124 Ops/s 526.9953 Ops/s $\color{#d91a1a}-0.89\%$
test_sac_speed[False-None] 9.1028ms 7.9794ms 125.3229 Ops/s 127.4747 Ops/s $\color{#d91a1a}-1.69\%$
test_sac_speed[False-backward] 11.1052ms 10.6778ms 93.6526 Ops/s 93.6169 Ops/s $\color{#35bf28}+0.04\%$
test_sac_speed[True-None] 2.4173ms 1.8620ms 537.0587 Ops/s 539.9092 Ops/s $\color{#d91a1a}-0.53\%$
test_sac_speed[True-backward] 3.6114ms 3.5446ms 282.1157 Ops/s 281.4363 Ops/s $\color{#35bf28}+0.24\%$
test_sac_speed[reduce-overhead-None] 2.4263ms 1.8622ms 536.9996 Ops/s 538.2553 Ops/s $\color{#d91a1a}-0.23\%$
test_sac_speed[reduce-overhead-backward] 3.7632ms 3.5720ms 279.9569 Ops/s 280.1124 Ops/s $\color{#d91a1a}-0.06\%$
test_redq_speed[False-None] 15.3984ms 13.1564ms 76.0087 Ops/s 76.8055 Ops/s $\color{#d91a1a}-1.04\%$
test_redq_speed[False-backward] 38.9557ms 23.1204ms 43.2519 Ops/s 44.7326 Ops/s $\color{#d91a1a}-3.31\%$
test_redq_speed[True-None] 5.1285ms 4.5674ms 218.9442 Ops/s 217.6115 Ops/s $\color{#35bf28}+0.61\%$
test_redq_speed[True-backward] 13.5199ms 12.1771ms 82.1217 Ops/s 81.9180 Ops/s $\color{#35bf28}+0.25\%$
test_redq_speed[reduce-overhead-None] 5.5486ms 4.7501ms 210.5201 Ops/s 216.1736 Ops/s $\color{#d91a1a}-2.62\%$
test_redq_speed[reduce-overhead-backward] 12.5996ms 12.1967ms 81.9892 Ops/s 81.8597 Ops/s $\color{#35bf28}+0.16\%$
test_redq_deprec_speed[False-None] 14.4447ms 12.7305ms 78.5517 Ops/s 78.9629 Ops/s $\color{#d91a1a}-0.52\%$
test_redq_deprec_speed[False-backward] 19.8231ms 18.6429ms 53.6397 Ops/s 54.6006 Ops/s $\color{#d91a1a}-1.76\%$
test_redq_deprec_speed[True-None] 4.4460ms 3.5908ms 278.4894 Ops/s 279.5285 Ops/s $\color{#d91a1a}-0.37\%$
test_redq_deprec_speed[True-backward] 8.8910ms 8.0282ms 124.5606 Ops/s 115.8143 Ops/s $\textbf{\color{#35bf28}+7.55\%}$
test_redq_deprec_speed[reduce-overhead-None] 4.4539ms 3.6120ms 276.8555 Ops/s 277.8182 Ops/s $\color{#d91a1a}-0.35\%$
test_redq_deprec_speed[reduce-overhead-backward] 9.0825ms 8.0757ms 123.8288 Ops/s 115.2915 Ops/s $\textbf{\color{#35bf28}+7.40\%}$
test_td3_speed[False-None] 9.9759ms 7.9997ms 125.0051 Ops/s 124.8679 Ops/s $\color{#35bf28}+0.11\%$
test_td3_speed[False-backward] 11.8534ms 10.4946ms 95.2875 Ops/s 95.3526 Ops/s $\color{#d91a1a}-0.07\%$
test_td3_speed[True-None] 1.8676ms 1.7598ms 568.2467 Ops/s 564.5725 Ops/s $\color{#35bf28}+0.65\%$
test_td3_speed[True-backward] 3.4327ms 3.3469ms 298.7863 Ops/s 297.9355 Ops/s $\color{#35bf28}+0.29\%$
test_td3_speed[reduce-overhead-None] 1.9418ms 1.7449ms 573.0949 Ops/s 568.5319 Ops/s $\color{#35bf28}+0.80\%$
test_td3_speed[reduce-overhead-backward] 3.7602ms 3.3786ms 295.9802 Ops/s 296.9545 Ops/s $\color{#d91a1a}-0.33\%$
test_cql_speed[False-None] 38.9068ms 35.9953ms 27.7814 Ops/s 27.8420 Ops/s $\color{#d91a1a}-0.22\%$
test_cql_speed[False-backward] 49.4507ms 46.2267ms 21.6325 Ops/s 21.4984 Ops/s $\color{#35bf28}+0.62\%$
test_cql_speed[True-None] 16.4963ms 15.8087ms 63.2562 Ops/s 63.7355 Ops/s $\color{#d91a1a}-0.75\%$
test_cql_speed[True-backward] 23.2579ms 22.2280ms 44.9883 Ops/s 43.5302 Ops/s $\color{#35bf28}+3.35\%$
test_cql_speed[reduce-overhead-None] 17.1427ms 15.7210ms 63.6091 Ops/s 63.6815 Ops/s $\color{#d91a1a}-0.11\%$
test_cql_speed[reduce-overhead-backward] 23.2472ms 22.4374ms 44.5685 Ops/s 44.6710 Ops/s $\color{#d91a1a}-0.23\%$
test_a2c_speed[False-None] 9.9188ms 7.3159ms 136.6882 Ops/s 140.3691 Ops/s $\color{#d91a1a}-2.62\%$
test_a2c_speed[False-backward] 14.9948ms 14.1905ms 70.4694 Ops/s 70.3983 Ops/s $\color{#35bf28}+0.10\%$
test_a2c_speed[True-None] 3.6042ms 3.3210ms 301.1168 Ops/s 301.7155 Ops/s $\color{#d91a1a}-0.20\%$
test_a2c_speed[True-backward] 10.8518ms 9.8007ms 102.0339 Ops/s 102.5769 Ops/s $\color{#d91a1a}-0.53\%$
test_a2c_speed[reduce-overhead-None] 7.5105ms 3.4119ms 293.0955 Ops/s 299.4150 Ops/s $\color{#d91a1a}-2.11\%$
test_a2c_speed[reduce-overhead-backward] 11.0852ms 9.7994ms 102.0471 Ops/s 102.1868 Ops/s $\color{#d91a1a}-0.14\%$
test_ppo_speed[False-None] 10.0874ms 7.4341ms 134.5160 Ops/s 135.0516 Ops/s $\color{#d91a1a}-0.40\%$
test_ppo_speed[False-backward] 15.6924ms 14.7627ms 67.7382 Ops/s 68.3646 Ops/s $\color{#d91a1a}-0.92\%$
test_ppo_speed[True-None] 4.0397ms 3.7124ms 269.3641 Ops/s 269.1103 Ops/s $\color{#35bf28}+0.09\%$
test_ppo_speed[True-backward] 10.1951ms 9.6264ms 103.8808 Ops/s 103.0442 Ops/s $\color{#35bf28}+0.81\%$
test_ppo_speed[reduce-overhead-None] 4.0306ms 3.7105ms 269.5068 Ops/s 266.1704 Ops/s $\color{#35bf28}+1.25\%$
test_ppo_speed[reduce-overhead-backward] 9.9747ms 9.6193ms 103.9573 Ops/s 103.8566 Ops/s $\color{#35bf28}+0.10\%$
test_reinforce_speed[False-None] 7.3149ms 6.4286ms 155.5558 Ops/s 154.4037 Ops/s $\color{#35bf28}+0.75\%$
test_reinforce_speed[False-backward] 11.2753ms 9.7597ms 102.4626 Ops/s 102.5215 Ops/s $\color{#d91a1a}-0.06\%$
test_reinforce_speed[True-None] 3.1586ms 2.6421ms 378.4924 Ops/s 378.5468 Ops/s $\color{#d91a1a}-0.01\%$
test_reinforce_speed[True-backward] 9.1847ms 8.6956ms 115.0004 Ops/s 116.9719 Ops/s $\color{#d91a1a}-1.69\%$
test_reinforce_speed[reduce-overhead-None] 2.9454ms 2.6441ms 378.1967 Ops/s 377.1623 Ops/s $\color{#35bf28}+0.27\%$
test_reinforce_speed[reduce-overhead-backward] 8.9432ms 8.5998ms 116.2817 Ops/s 114.9555 Ops/s $\color{#35bf28}+1.15\%$
test_iql_speed[False-None] 32.6560ms 32.1519ms 31.1023 Ops/s 31.0892 Ops/s $\color{#35bf28}+0.04\%$
test_iql_speed[False-backward] 47.1332ms 45.3012ms 22.0745 Ops/s 22.1097 Ops/s $\color{#d91a1a}-0.16\%$
test_iql_speed[True-None] 11.8576ms 10.8643ms 92.0450 Ops/s 91.5319 Ops/s $\color{#35bf28}+0.56\%$
test_iql_speed[True-backward] 22.4715ms 21.6440ms 46.2023 Ops/s 46.0161 Ops/s $\color{#35bf28}+0.40\%$
test_iql_speed[reduce-overhead-None] 11.7803ms 10.6596ms 93.8124 Ops/s 93.5477 Ops/s $\color{#35bf28}+0.28\%$
test_iql_speed[reduce-overhead-backward] 22.7743ms 21.7305ms 46.0182 Ops/s 45.9069 Ops/s $\color{#35bf28}+0.24\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.2684ms 4.8661ms 205.5047 Ops/s 202.0444 Ops/s $\color{#35bf28}+1.71\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7368ms 0.4797ms 2.0846 KOps/s 2.0598 KOps/s $\color{#35bf28}+1.20\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6998ms 0.4586ms 2.1805 KOps/s 2.2023 KOps/s $\color{#d91a1a}-0.99\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.7043ms 4.6265ms 216.1456 Ops/s 214.7325 Ops/s $\color{#35bf28}+0.66\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 3.3004ms 0.4761ms 2.1004 KOps/s 2.1249 KOps/s $\color{#d91a1a}-1.15\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6657ms 0.4520ms 2.2123 KOps/s 2.2255 KOps/s $\color{#d91a1a}-0.59\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.7999ms 1.5862ms 630.4358 Ops/s 631.9734 Ops/s $\color{#d91a1a}-0.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.2607ms 1.5410ms 648.9244 Ops/s 655.2375 Ops/s $\color{#d91a1a}-0.96\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.3366ms 4.8021ms 208.2421 Ops/s 208.1490 Ops/s $\color{#35bf28}+0.04\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.3866ms 0.6156ms 1.6246 KOps/s 1.6081 KOps/s $\color{#35bf28}+1.02\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8398ms 0.5939ms 1.6837 KOps/s 1.6830 KOps/s $\color{#35bf28}+0.04\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 4.9535ms 4.6795ms 213.6983 Ops/s 209.8800 Ops/s $\color{#35bf28}+1.82\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 3.0100ms 0.4831ms 2.0698 KOps/s 2.0973 KOps/s $\color{#d91a1a}-1.31\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6912ms 0.4594ms 2.1769 KOps/s 2.1760 KOps/s $\color{#35bf28}+0.04\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.5100ms 4.6344ms 215.7788 Ops/s 216.1621 Ops/s $\color{#d91a1a}-0.18\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6489ms 0.4735ms 2.1120 KOps/s 2.0982 KOps/s $\color{#35bf28}+0.66\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 7.8813ms 0.4650ms 2.1507 KOps/s 2.1873 KOps/s $\color{#d91a1a}-1.67\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.0100ms 4.7980ms 208.4200 Ops/s 205.5690 Ops/s $\color{#35bf28}+1.39\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.4316ms 0.6162ms 1.6229 KOps/s 1.6099 KOps/s $\color{#35bf28}+0.81\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8468ms 0.5932ms 1.6858 KOps/s 1.6946 KOps/s $\color{#d91a1a}-0.52\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 5.4552ms 4.2332ms 236.2276 Ops/s 233.8619 Ops/s $\color{#35bf28}+1.01\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 4.8114ms 2.2238ms 449.6834 Ops/s 414.0117 Ops/s $\textbf{\color{#35bf28}+8.62\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.5524ms 1.2965ms 771.3314 Ops/s 773.6108 Ops/s $\color{#d91a1a}-0.29\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.4052s 12.3916ms 80.6995 Ops/s 232.4099 Ops/s $\textbf{\color{#d91a1a}-65.28\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 6.3648ms 2.2332ms 447.7918 Ops/s 434.9106 Ops/s $\color{#35bf28}+2.96\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 5.5401ms 1.2865ms 777.3053 Ops/s 767.9478 Ops/s $\color{#35bf28}+1.22\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 5.7057ms 4.4307ms 225.7002 Ops/s 226.3336 Ops/s $\color{#d91a1a}-0.28\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 7.8316ms 2.3544ms 424.7372 Ops/s 418.3162 Ops/s $\color{#35bf28}+1.53\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 5.0096ms 1.4000ms 714.2922 Ops/s 658.7902 Ops/s $\textbf{\color{#35bf28}+8.42\%}$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 143. Improved: $\large\color{#35bf28}14$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.7347s 0.7248s 1.3797 Ops/s 1.3495 Ops/s $\color{#35bf28}+2.24\%$
test_transformed 1.0523s 0.9809s 1.0195 Ops/s 1.0415 Ops/s $\color{#d91a1a}-2.11\%$
test_serial 2.1867s 2.1095s 0.4740 Ops/s 0.4792 Ops/s $\color{#d91a1a}-1.07\%$
test_parallel 2.0365s 1.9582s 0.5107 Ops/s 0.5106 Ops/s $\color{#35bf28}+0.01\%$
test_step_mdp_speed[True-True-True-True-True] 0.1961ms 38.2923μs 26.1149 KOps/s 26.2333 KOps/s $\color{#d91a1a}-0.45\%$
test_step_mdp_speed[True-True-True-True-False] 52.3320μs 21.7823μs 45.9087 KOps/s 45.9629 KOps/s $\color{#d91a1a}-0.12\%$
test_step_mdp_speed[True-True-True-False-True] 51.0520μs 20.1588μs 49.6062 KOps/s 48.9011 KOps/s $\color{#35bf28}+1.44\%$
test_step_mdp_speed[True-True-True-False-False] 45.5830μs 11.8599μs 84.3174 KOps/s 84.8092 KOps/s $\color{#d91a1a}-0.58\%$
test_step_mdp_speed[True-True-False-True-True] 70.8230μs 39.9327μs 25.0422 KOps/s 24.5629 KOps/s $\color{#35bf28}+1.95\%$
test_step_mdp_speed[True-True-False-True-False] 83.7140μs 23.3784μs 42.7745 KOps/s 41.3115 KOps/s $\color{#35bf28}+3.54\%$
test_step_mdp_speed[True-True-False-False-True] 54.3130μs 22.7175μs 44.0189 KOps/s 43.8132 KOps/s $\color{#35bf28}+0.47\%$
test_step_mdp_speed[True-True-False-False-False] 37.8520μs 14.4667μs 69.1243 KOps/s 69.5895 KOps/s $\color{#d91a1a}-0.67\%$
test_step_mdp_speed[True-False-True-True-True] 77.8230μs 42.9158μs 23.3014 KOps/s 23.3596 KOps/s $\color{#d91a1a}-0.25\%$
test_step_mdp_speed[True-False-True-True-False] 55.9630μs 27.6845μs 36.1213 KOps/s 38.1269 KOps/s $\textbf{\color{#d91a1a}-5.26\%}$
test_step_mdp_speed[True-False-True-False-True] 58.8030μs 23.1257μs 43.2419 KOps/s 43.7734 KOps/s $\color{#d91a1a}-1.21\%$
test_step_mdp_speed[True-False-True-False-False] 39.1820μs 14.5134μs 68.9019 KOps/s 68.2025 KOps/s $\color{#35bf28}+1.03\%$
test_step_mdp_speed[True-False-False-True-True] 75.9140μs 45.7250μs 21.8699 KOps/s 22.3623 KOps/s $\color{#d91a1a}-2.20\%$
test_step_mdp_speed[True-False-False-True-False] 59.6330μs 29.9406μs 33.3995 KOps/s 33.9960 KOps/s $\color{#d91a1a}-1.75\%$
test_step_mdp_speed[True-False-False-False-True] 59.3730μs 25.5236μs 39.1795 KOps/s 39.7435 KOps/s $\color{#d91a1a}-1.42\%$
test_step_mdp_speed[True-False-False-False-False] 48.9830μs 17.1743μs 58.2266 KOps/s 59.6940 KOps/s $\color{#d91a1a}-2.46\%$
test_step_mdp_speed[False-True-True-True-True] 70.4130μs 43.2446μs 23.1243 KOps/s 23.6078 KOps/s $\color{#d91a1a}-2.05\%$
test_step_mdp_speed[False-True-True-True-False] 63.2030μs 27.2172μs 36.7414 KOps/s 37.1338 KOps/s $\color{#d91a1a}-1.06\%$
test_step_mdp_speed[False-True-True-False-True] 58.9630μs 27.3574μs 36.5532 KOps/s 36.0113 KOps/s $\color{#35bf28}+1.50\%$
test_step_mdp_speed[False-True-True-False-False] 56.1230μs 17.0364μs 58.6979 KOps/s 60.4475 KOps/s $\color{#d91a1a}-2.89\%$
test_step_mdp_speed[False-True-False-True-True] 80.9940μs 45.7965μs 21.8357 KOps/s 22.7371 KOps/s $\color{#d91a1a}-3.96\%$
test_step_mdp_speed[False-True-False-True-False] 64.5130μs 29.8438μs 33.5078 KOps/s 34.0680 KOps/s $\color{#d91a1a}-1.64\%$
test_step_mdp_speed[False-True-False-False-True] 3.2598ms 30.4201μs 32.8730 KOps/s 33.8850 KOps/s $\color{#d91a1a}-2.99\%$
test_step_mdp_speed[False-True-False-False-False] 49.2820μs 19.4636μs 51.3781 KOps/s 52.7467 KOps/s $\color{#d91a1a}-2.59\%$
test_step_mdp_speed[False-False-True-True-True] 81.7540μs 48.0901μs 20.7943 KOps/s 20.9945 KOps/s $\color{#d91a1a}-0.95\%$
test_step_mdp_speed[False-False-True-True-False] 67.4530μs 32.7334μs 30.5499 KOps/s 31.1173 KOps/s $\color{#d91a1a}-1.82\%$
test_step_mdp_speed[False-False-True-False-True] 62.8730μs 29.6153μs 33.7663 KOps/s 33.9052 KOps/s $\color{#d91a1a}-0.41\%$
test_step_mdp_speed[False-False-True-False-False] 48.5920μs 19.1087μs 52.3323 KOps/s 52.7245 KOps/s $\color{#d91a1a}-0.74\%$
test_step_mdp_speed[False-False-False-True-True] 78.5940μs 50.8055μs 19.6829 KOps/s 20.3297 KOps/s $\color{#d91a1a}-3.18\%$
test_step_mdp_speed[False-False-False-True-False] 69.5930μs 35.1963μs 28.4121 KOps/s 29.4692 KOps/s $\color{#d91a1a}-3.59\%$
test_step_mdp_speed[False-False-False-False-True] 64.1530μs 31.5353μs 31.7105 KOps/s 31.6408 KOps/s $\color{#35bf28}+0.22\%$
test_step_mdp_speed[False-False-False-False-False] 46.5320μs 21.7759μs 45.9222 KOps/s 47.0786 KOps/s $\color{#d91a1a}-2.46\%$
test_values[generalized_advantage_estimate-True-True] 25.1282ms 24.1915ms 41.3369 Ops/s 41.3057 Ops/s $\color{#35bf28}+0.08\%$
test_values[vec_generalized_advantage_estimate-True-True] 0.1205s 3.2948ms 303.5045 Ops/s 358.1808 Ops/s $\textbf{\color{#d91a1a}-15.26\%}$
test_values[td0_return_estimate-False-False] 86.0540μs 66.6537μs 15.0029 KOps/s 15.4220 KOps/s $\color{#d91a1a}-2.72\%$
test_values[td1_return_estimate-False-False] 54.2600ms 53.8706ms 18.5630 Ops/s 18.4613 Ops/s $\color{#35bf28}+0.55\%$
test_values[vec_td1_return_estimate-False-False] 1.3127ms 1.0627ms 940.9806 Ops/s 937.2214 Ops/s $\color{#35bf28}+0.40\%$
test_values[td_lambda_return_estimate-True-False] 85.7319ms 85.1234ms 11.7477 Ops/s 11.6392 Ops/s $\color{#35bf28}+0.93\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.3058ms 1.0599ms 943.4834 Ops/s 926.2718 Ops/s $\color{#35bf28}+1.86\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 23.9196ms 23.7495ms 42.1061 Ops/s 41.4811 Ops/s $\color{#35bf28}+1.51\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.0156ms 0.7341ms 1.3622 KOps/s 1.3525 KOps/s $\color{#35bf28}+0.72\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7456ms 0.6529ms 1.5317 KOps/s 1.5198 KOps/s $\color{#35bf28}+0.78\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5068ms 1.4610ms 684.4533 Ops/s 682.0883 Ops/s $\color{#35bf28}+0.35\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7214ms 0.6680ms 1.4970 KOps/s 1.4812 KOps/s $\color{#35bf28}+1.07\%$
test_dqn_speed[False-None] 6.6298ms 1.3100ms 763.3645 Ops/s 761.1257 Ops/s $\color{#35bf28}+0.29\%$
test_dqn_speed[False-backward] 1.9138ms 1.8230ms 548.5544 Ops/s 554.4996 Ops/s $\color{#d91a1a}-1.07\%$
test_dqn_speed[True-None] 0.7999ms 0.5455ms 1.8332 KOps/s 1.7750 KOps/s $\color{#35bf28}+3.28\%$
test_dqn_speed[True-backward] 1.0664ms 0.9845ms 1.0158 KOps/s 991.7802 Ops/s $\color{#35bf28}+2.42\%$
test_dqn_speed[reduce-overhead-None] 0.7513ms 0.5544ms 1.8036 KOps/s 1.7781 KOps/s $\color{#35bf28}+1.43\%$
test_dqn_speed[reduce-overhead-backward] 1.0218ms 0.9820ms 1.0183 KOps/s 980.5736 Ops/s $\color{#35bf28}+3.85\%$
test_ddpg_speed[False-None] 3.0156ms 2.6899ms 371.7583 Ops/s 366.0109 Ops/s $\color{#35bf28}+1.57\%$
test_ddpg_speed[False-backward] 4.0791ms 3.9244ms 254.8179 Ops/s 255.1734 Ops/s $\color{#d91a1a}-0.14\%$
test_ddpg_speed[True-None] 1.3495ms 1.2154ms 822.7406 Ops/s 816.7560 Ops/s $\color{#35bf28}+0.73\%$
test_ddpg_speed[True-backward] 2.2342ms 2.1650ms 461.9018 Ops/s 457.8302 Ops/s $\color{#35bf28}+0.89\%$
test_ddpg_speed[reduce-overhead-None] 1.5189ms 1.2206ms 819.2660 Ops/s 823.5009 Ops/s $\color{#d91a1a}-0.51\%$
test_ddpg_speed[reduce-overhead-backward] 2.2011ms 2.1598ms 463.0003 Ops/s 460.7077 Ops/s $\color{#35bf28}+0.50\%$
test_sac_speed[False-None] 8.0922ms 7.5024ms 133.2907 Ops/s 131.5718 Ops/s $\color{#35bf28}+1.31\%$
test_sac_speed[False-backward] 11.0966ms 10.6510ms 93.8878 Ops/s 92.3653 Ops/s $\color{#35bf28}+1.65\%$
test_sac_speed[True-None] 2.2768ms 1.9956ms 501.0900 Ops/s 502.1985 Ops/s $\color{#d91a1a}-0.22\%$
test_sac_speed[True-backward] 4.2408ms 3.8859ms 257.3393 Ops/s 250.6973 Ops/s $\color{#35bf28}+2.65\%$
test_sac_speed[reduce-overhead-None] 2.2413ms 1.9922ms 501.9624 Ops/s 501.6323 Ops/s $\color{#35bf28}+0.07\%$
test_sac_speed[reduce-overhead-backward] 4.0307ms 3.8885ms 257.1688 Ops/s 258.7286 Ops/s $\color{#d91a1a}-0.60\%$
test_redq_speed[False-None] 11.0179ms 9.9215ms 100.7915 Ops/s 80.7712 Ops/s $\textbf{\color{#35bf28}+24.79\%}$
test_redq_speed[False-backward] 20.4688ms 17.1770ms 58.2172 Ops/s 57.6288 Ops/s $\color{#35bf28}+1.02\%$
test_redq_speed[True-None] 3.9037ms 3.5063ms 285.2002 Ops/s 282.4833 Ops/s $\color{#35bf28}+0.96\%$
test_redq_speed[True-backward] 8.9557ms 8.4236ms 118.7147 Ops/s 118.4748 Ops/s $\color{#35bf28}+0.20\%$
test_redq_speed[reduce-overhead-None] 3.9970ms 3.4865ms 286.8200 Ops/s 286.5812 Ops/s $\color{#35bf28}+0.08\%$
test_redq_speed[reduce-overhead-backward] 8.6983ms 8.3623ms 119.5846 Ops/s 117.2092 Ops/s $\color{#35bf28}+2.03\%$
test_redq_deprec_speed[False-None] 10.8343ms 10.4618ms 95.5863 Ops/s 94.9009 Ops/s $\color{#35bf28}+0.72\%$
test_redq_deprec_speed[False-backward] 16.1077ms 15.1259ms 66.1119 Ops/s 65.7154 Ops/s $\color{#35bf28}+0.60\%$
test_redq_deprec_speed[True-None] 3.5056ms 3.1232ms 320.1838 Ops/s 302.7445 Ops/s $\textbf{\color{#35bf28}+5.76\%}$
test_redq_deprec_speed[True-backward] 7.3461ms 6.9163ms 144.5862 Ops/s 143.5920 Ops/s $\color{#35bf28}+0.69\%$
test_redq_deprec_speed[reduce-overhead-None] 3.4813ms 3.1222ms 320.2903 Ops/s 322.0374 Ops/s $\color{#d91a1a}-0.54\%$
test_redq_deprec_speed[reduce-overhead-backward] 7.2081ms 6.9442ms 144.0049 Ops/s 146.5870 Ops/s $\color{#d91a1a}-1.76\%$
test_td3_speed[False-None] 7.6583ms 7.4599ms 134.0507 Ops/s 131.5927 Ops/s $\color{#35bf28}+1.87\%$
test_td3_speed[False-backward] 10.5250ms 10.2406ms 97.6503 Ops/s 95.9841 Ops/s $\color{#35bf28}+1.74\%$
test_td3_speed[True-None] 1.8909ms 1.8633ms 536.6700 Ops/s 524.6892 Ops/s $\color{#35bf28}+2.28\%$
test_td3_speed[True-backward] 3.7785ms 3.6467ms 274.2175 Ops/s 250.3544 Ops/s $\textbf{\color{#35bf28}+9.53\%}$
test_td3_speed[reduce-overhead-None] 1.8935ms 1.8645ms 536.3407 Ops/s 529.9702 Ops/s $\color{#35bf28}+1.20\%$
test_td3_speed[reduce-overhead-backward] 3.7534ms 3.6139ms 276.7124 Ops/s 274.3757 Ops/s $\color{#35bf28}+0.85\%$
test_cql_speed[False-None] 27.2610ms 24.6490ms 40.5696 Ops/s 41.0168 Ops/s $\color{#d91a1a}-1.09\%$
test_cql_speed[False-backward] 38.3875ms 34.1995ms 29.2402 Ops/s 30.0250 Ops/s $\color{#d91a1a}-2.61\%$
test_cql_speed[True-None] 11.1787ms 10.8029ms 92.5676 Ops/s 95.8667 Ops/s $\color{#d91a1a}-3.44\%$
test_cql_speed[True-backward] 16.7302ms 16.3505ms 61.1601 Ops/s 62.0773 Ops/s $\color{#d91a1a}-1.48\%$
test_cql_speed[reduce-overhead-None] 11.4623ms 10.8639ms 92.0482 Ops/s 93.3304 Ops/s $\color{#d91a1a}-1.37\%$
test_cql_speed[reduce-overhead-backward] 16.9254ms 16.5091ms 60.5726 Ops/s 61.8913 Ops/s $\color{#d91a1a}-2.13\%$
test_a2c_speed[False-None] 5.5346ms 5.2636ms 189.9832 Ops/s 189.6388 Ops/s $\color{#35bf28}+0.18\%$
test_a2c_speed[False-backward] 11.9748ms 11.6274ms 86.0035 Ops/s 85.5456 Ops/s $\color{#35bf28}+0.54\%$
test_a2c_speed[True-None] 3.4173ms 3.0238ms 330.7134 Ops/s 327.6392 Ops/s $\color{#35bf28}+0.94\%$
test_a2c_speed[True-backward] 8.7777ms 8.4270ms 118.6666 Ops/s 114.3283 Ops/s $\color{#35bf28}+3.79\%$
test_a2c_speed[reduce-overhead-None] 3.1996ms 3.0404ms 328.8989 Ops/s 330.5096 Ops/s $\color{#d91a1a}-0.49\%$
test_a2c_speed[reduce-overhead-backward] 8.7199ms 8.3092ms 120.3485 Ops/s 119.0401 Ops/s $\color{#35bf28}+1.10\%$
test_ppo_speed[False-None] 5.8938ms 5.5693ms 179.5557 Ops/s 178.7174 Ops/s $\color{#35bf28}+0.47\%$
test_ppo_speed[False-backward] 12.3573ms 11.9256ms 83.8531 Ops/s 83.2703 Ops/s $\color{#35bf28}+0.70\%$
test_ppo_speed[True-None] 3.7572ms 3.4390ms 290.7797 Ops/s 291.1383 Ops/s $\color{#d91a1a}-0.12\%$
test_ppo_speed[True-backward] 8.4278ms 8.1595ms 122.5569 Ops/s 121.8993 Ops/s $\color{#35bf28}+0.54\%$
test_ppo_speed[reduce-overhead-None] 3.6092ms 3.4229ms 292.1522 Ops/s 290.6675 Ops/s $\color{#35bf28}+0.51\%$
test_ppo_speed[reduce-overhead-backward] 8.5519ms 8.1712ms 122.3815 Ops/s 121.6838 Ops/s $\color{#35bf28}+0.57\%$
test_reinforce_speed[False-None] 4.7921ms 4.3241ms 231.2646 Ops/s 225.3393 Ops/s $\color{#35bf28}+2.63\%$
test_reinforce_speed[False-backward] 7.3423ms 7.0584ms 141.6747 Ops/s 137.7757 Ops/s $\color{#35bf28}+2.83\%$
test_reinforce_speed[True-None] 2.4029ms 2.1855ms 457.5596 Ops/s 448.0764 Ops/s $\color{#35bf28}+2.12\%$
test_reinforce_speed[True-backward] 7.4483ms 6.9951ms 142.9563 Ops/s 138.4332 Ops/s $\color{#35bf28}+3.27\%$
test_reinforce_speed[reduce-overhead-None] 2.5757ms 2.1975ms 455.0609 Ops/s 454.7048 Ops/s $\color{#35bf28}+0.08\%$
test_reinforce_speed[reduce-overhead-backward] 7.2322ms 6.9750ms 143.3692 Ops/s 142.9513 Ops/s $\color{#35bf28}+0.29\%$
test_iql_speed[False-None] 19.9089ms 19.2512ms 51.9448 Ops/s 52.5516 Ops/s $\color{#d91a1a}-1.15\%$
test_iql_speed[False-backward] 34.9427ms 29.7435ms 33.6208 Ops/s 34.0337 Ops/s $\color{#d91a1a}-1.21\%$
test_iql_speed[True-None] 7.1483ms 6.6585ms 150.1837 Ops/s 147.6618 Ops/s $\color{#35bf28}+1.71\%$
test_iql_speed[True-backward] 16.3881ms 15.2893ms 65.4054 Ops/s 62.9956 Ops/s $\color{#35bf28}+3.83\%$
test_iql_speed[reduce-overhead-None] 7.0304ms 6.6242ms 150.9606 Ops/s 150.1491 Ops/s $\color{#35bf28}+0.54\%$
test_iql_speed[reduce-overhead-backward] 15.8377ms 15.2887ms 65.4080 Ops/s 65.1998 Ops/s $\color{#35bf28}+0.32\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.3347ms 6.1704ms 162.0643 Ops/s 162.6352 Ops/s $\color{#d91a1a}-0.35\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.8033ms 0.2358ms 4.2405 KOps/s 3.2926 KOps/s $\textbf{\color{#35bf28}+28.79\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.4570ms 0.2499ms 4.0013 KOps/s 3.1403 KOps/s $\textbf{\color{#35bf28}+27.42\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.2134ms 5.9535ms 167.9694 Ops/s 171.6164 Ops/s $\color{#d91a1a}-2.13\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.2569ms 0.2768ms 3.6124 KOps/s 3.2891 KOps/s $\textbf{\color{#35bf28}+9.83\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4302ms 0.2263ms 4.4191 KOps/s 3.5420 KOps/s $\textbf{\color{#35bf28}+24.76\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6052ms 1.2055ms 829.5562 Ops/s 665.1754 Ops/s $\textbf{\color{#35bf28}+24.71\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.3617ms 1.1654ms 858.0465 Ops/s 760.2918 Ops/s $\textbf{\color{#35bf28}+12.86\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.2693ms 6.0826ms 164.4035 Ops/s 165.7926 Ops/s $\color{#d91a1a}-0.84\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7772ms 0.4273ms 2.3404 KOps/s 2.2592 KOps/s $\color{#35bf28}+3.59\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.5756ms 0.3800ms 2.6313 KOps/s 2.5578 KOps/s $\color{#35bf28}+2.87\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.1090ms 5.9325ms 168.5622 Ops/s 171.7358 Ops/s $\color{#d91a1a}-1.85\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.1059ms 0.2845ms 3.5148 KOps/s 4.1768 KOps/s $\textbf{\color{#d91a1a}-15.85\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 1.3654ms 0.2761ms 3.6223 KOps/s 4.6493 KOps/s $\textbf{\color{#d91a1a}-22.09\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.1718ms 5.8771ms 170.1531 Ops/s 173.2125 Ops/s $\color{#d91a1a}-1.77\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8257ms 0.2324ms 4.3025 KOps/s 3.0160 KOps/s $\textbf{\color{#35bf28}+42.65\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4138ms 0.2092ms 4.7798 KOps/s 3.3176 KOps/s $\textbf{\color{#35bf28}+44.07\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.3405ms 6.0772ms 164.5484 Ops/s 161.6801 Ops/s $\color{#35bf28}+1.77\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7355ms 0.3745ms 2.6703 KOps/s 2.3632 KOps/s $\textbf{\color{#35bf28}+13.00\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7183ms 0.3566ms 2.8044 KOps/s 2.4976 KOps/s $\textbf{\color{#35bf28}+12.28\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.7314ms 5.1761ms 193.1965 Ops/s 188.8856 Ops/s $\color{#35bf28}+2.28\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 9.5548ms 2.3089ms 433.1019 Ops/s 497.0407 Ops/s $\textbf{\color{#d91a1a}-12.86\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.1977ms 1.0743ms 930.8411 Ops/s 850.4434 Ops/s $\textbf{\color{#35bf28}+9.45\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.4228s 13.6380ms 73.3245 Ops/s 187.5907 Ops/s $\textbf{\color{#d91a1a}-60.91\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 7.7947ms 1.9826ms 504.3767 Ops/s 497.4510 Ops/s $\color{#35bf28}+1.39\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.8127ms 1.2411ms 805.7283 Ops/s 845.0084 Ops/s $\color{#d91a1a}-4.65\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 7.6614ms 5.4132ms 184.7321 Ops/s 181.1191 Ops/s $\color{#35bf28}+1.99\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 9.6780ms 2.1515ms 464.7842 Ops/s 455.7736 Ops/s $\color{#35bf28}+1.98\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.5623ms 1.3606ms 734.9439 Ops/s 828.3857 Ops/s $\textbf{\color{#d91a1a}-11.28\%}$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot