Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] Fix CI errors #2394

Merged
merged 1 commit into from
Aug 13, 2024
Merged

[CI] Fix CI errors #2394

merged 1 commit into from
Aug 13, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Aug 13, 2024 •
edited
Loading

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Aug 13, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2394

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 5 Unrelated Failures

As of commit 11a0141 with merge base bb0ddb5 (image):

NEW FAILURE - The following job has failed:

FLAKY - The following job failed but was likely due to flakiness present on trunk:

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 13, 2024
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}8$. Worsened: $\large\color{#d91a1a}1$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 59.6256ms 58.7812ms 17.0123 Ops/s 15.9431 Ops/s $\textbf{\color{#35bf28}+6.71\%}$
test_sync 40.7389ms 33.0835ms 30.2265 Ops/s 29.1822 Ops/s $\color{#35bf28}+3.58\%$
test_async 68.9638ms 31.2619ms 31.9878 Ops/s 30.7449 Ops/s $\color{#35bf28}+4.04\%$
test_simple 0.5090s 0.4286s 2.3330 Ops/s 2.2199 Ops/s $\textbf{\color{#35bf28}+5.10\%}$
test_transformed 0.6629s 0.5904s 1.6939 Ops/s 1.6210 Ops/s $\color{#35bf28}+4.50\%$
test_serial 1.3596s 1.2826s 0.7796 Ops/s 0.7467 Ops/s $\color{#35bf28}+4.42\%$
test_parallel 1.1378s 1.1287s 0.8860 Ops/s 0.8742 Ops/s $\color{#35bf28}+1.35\%$
test_step_mdp_speed[True-True-True-True-True] 0.2710ms 25.5184μs 39.1873 KOps/s 39.3025 KOps/s $\color{#d91a1a}-0.29\%$
test_step_mdp_speed[True-True-True-True-False] 77.7980μs 14.8669μs 67.2636 KOps/s 66.7038 KOps/s $\color{#35bf28}+0.84\%$
test_step_mdp_speed[True-True-True-False-True] 72.9860μs 14.5922μs 68.5299 KOps/s 68.4271 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[True-True-True-False-False] 34.9450μs 8.6071μs 116.1833 KOps/s 118.2132 KOps/s $\color{#d91a1a}-1.72\%$
test_step_mdp_speed[True-True-False-True-True] 90.4200μs 27.1053μs 36.8931 KOps/s 36.8467 KOps/s $\color{#35bf28}+0.13\%$
test_step_mdp_speed[True-True-False-True-False] 44.9140μs 16.3466μs 61.1749 KOps/s 61.2912 KOps/s $\color{#d91a1a}-0.19\%$
test_step_mdp_speed[True-True-False-False-True] 71.2130μs 16.1020μs 62.1039 KOps/s 61.2234 KOps/s $\color{#35bf28}+1.44\%$
test_step_mdp_speed[True-True-False-False-False] 36.4880μs 10.0833μs 99.1734 KOps/s 99.7070 KOps/s $\color{#d91a1a}-0.54\%$
test_step_mdp_speed[True-False-True-True-True] 97.5430μs 28.9626μs 34.5272 KOps/s 34.5662 KOps/s $\color{#d91a1a}-0.11\%$
test_step_mdp_speed[True-False-True-True-False] 46.2160μs 17.9934μs 55.5759 KOps/s 55.6835 KOps/s $\color{#d91a1a}-0.19\%$
test_step_mdp_speed[True-False-True-False-True] 77.8760μs 16.1068μs 62.0856 KOps/s 61.8724 KOps/s $\color{#35bf28}+0.34\%$
test_step_mdp_speed[True-False-True-False-False] 49.2920μs 10.0947μs 99.0624 KOps/s 99.3512 KOps/s $\color{#d91a1a}-0.29\%$
test_step_mdp_speed[True-False-False-True-True] 65.7530μs 29.9539μs 33.3847 KOps/s 33.1051 KOps/s $\color{#35bf28}+0.84\%$
test_step_mdp_speed[True-False-False-True-False] 61.1440μs 19.3815μs 51.5955 KOps/s 51.5086 KOps/s $\color{#35bf28}+0.17\%$
test_step_mdp_speed[True-False-False-False-True] 55.0020μs 17.7085μs 56.4700 KOps/s 56.7483 KOps/s $\color{#d91a1a}-0.49\%$
test_step_mdp_speed[True-False-False-False-False] 62.5570μs 11.5014μs 86.9462 KOps/s 86.5209 KOps/s $\color{#35bf28}+0.49\%$
test_step_mdp_speed[False-True-True-True-True] 73.1760μs 28.6755μs 34.8730 KOps/s 34.5962 KOps/s $\color{#35bf28}+0.80\%$
test_step_mdp_speed[False-True-True-True-False] 86.8220μs 17.9792μs 55.6197 KOps/s 55.6524 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[False-True-True-False-True] 66.7450μs 18.7257μs 53.4026 KOps/s 51.6644 KOps/s $\color{#35bf28}+3.36\%$
test_step_mdp_speed[False-True-True-False-False] 38.3010μs 11.3303μs 88.2587 KOps/s 88.2101 KOps/s $\color{#35bf28}+0.06\%$
test_step_mdp_speed[False-True-False-True-True] 0.1035ms 29.9132μs 33.4301 KOps/s 32.8634 KOps/s $\color{#35bf28}+1.72\%$
test_step_mdp_speed[False-True-False-True-False] 61.8650μs 19.4381μs 51.4454 KOps/s 50.7709 KOps/s $\color{#35bf28}+1.33\%$
test_step_mdp_speed[False-True-False-False-True] 77.5750μs 20.3491μs 49.1423 KOps/s 47.7537 KOps/s $\color{#35bf28}+2.91\%$
test_step_mdp_speed[False-True-False-False-False] 50.3640μs 12.8285μs 77.9512 KOps/s 77.6183 KOps/s $\color{#35bf28}+0.43\%$
test_step_mdp_speed[False-False-True-True-True] 3.5330ms 32.0150μs 31.2354 KOps/s 30.3969 KOps/s $\color{#35bf28}+2.76\%$
test_step_mdp_speed[False-False-True-True-False] 79.5180μs 21.0153μs 47.5844 KOps/s 47.0348 KOps/s $\color{#35bf28}+1.17\%$
test_step_mdp_speed[False-False-True-False-True] 57.5370μs 20.6654μs 48.3901 KOps/s 49.4416 KOps/s $\color{#d91a1a}-2.13\%$
test_step_mdp_speed[False-False-True-False-False] 73.9380μs 12.8517μs 77.8110 KOps/s 78.0507 KOps/s $\color{#d91a1a}-0.31\%$
test_step_mdp_speed[False-False-False-True-True] 74.4390μs 32.9815μs 30.3200 KOps/s 29.8864 KOps/s $\color{#35bf28}+1.45\%$
test_step_mdp_speed[False-False-False-True-False] 71.7040μs 22.2235μs 44.9974 KOps/s 44.1252 KOps/s $\color{#35bf28}+1.98\%$
test_step_mdp_speed[False-False-False-False-True] 90.7790μs 21.7198μs 46.0410 KOps/s 45.9353 KOps/s $\color{#35bf28}+0.23\%$
test_step_mdp_speed[False-False-False-False-False] 52.9280μs 14.1834μs 70.5047 KOps/s 70.4261 KOps/s $\color{#35bf28}+0.11\%$
test_values[generalized_advantage_estimate-True-True] 10.2259ms 9.7335ms 102.7380 Ops/s 104.3329 Ops/s $\color{#d91a1a}-1.53\%$
test_values[vec_generalized_advantage_estimate-True-True] 37.9889ms 33.8888ms 29.5083 Ops/s 27.8436 Ops/s $\textbf{\color{#35bf28}+5.98\%}$
test_values[td0_return_estimate-False-False] 0.2741ms 0.1923ms 5.2010 KOps/s 5.4614 KOps/s $\color{#d91a1a}-4.77\%$
test_values[td1_return_estimate-False-False] 27.8736ms 24.5830ms 40.6785 Ops/s 40.4501 Ops/s $\color{#35bf28}+0.56\%$
test_values[vec_td1_return_estimate-False-False] 37.4699ms 34.9942ms 28.5762 Ops/s 27.7027 Ops/s $\color{#35bf28}+3.15\%$
test_values[td_lambda_return_estimate-True-False] 38.3695ms 35.3385ms 28.2977 Ops/s 28.1222 Ops/s $\color{#35bf28}+0.62\%$
test_values[vec_td_lambda_return_estimate-True-False] 36.5209ms 34.3608ms 29.1030 Ops/s 27.6740 Ops/s $\textbf{\color{#35bf28}+5.16\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.7919ms 8.3621ms 119.5868 Ops/s 119.7617 Ops/s $\color{#d91a1a}-0.15\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.4915ms 1.9377ms 516.0705 Ops/s 537.4435 Ops/s $\color{#d91a1a}-3.98\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5493ms 0.3570ms 2.8013 KOps/s 2.7259 KOps/s $\color{#35bf28}+2.77\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.7616ms 45.2680ms 22.0907 Ops/s 21.0205 Ops/s $\textbf{\color{#35bf28}+5.09\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.9989ms 3.0635ms 326.4253 Ops/s 325.3111 Ops/s $\color{#35bf28}+0.34\%$
test_dqn_speed 6.6398ms 1.3357ms 748.6680 Ops/s 751.0418 Ops/s $\color{#d91a1a}-0.32\%$
test_ddpg_speed 3.7804ms 2.8415ms 351.9220 Ops/s 361.0606 Ops/s $\color{#d91a1a}-2.53\%$
test_sac_speed 9.2016ms 8.2984ms 120.5058 Ops/s 118.1417 Ops/s $\color{#35bf28}+2.00\%$
test_redq_speed 14.8510ms 13.0353ms 76.7147 Ops/s 77.1525 Ops/s $\color{#d91a1a}-0.57\%$
test_redq_deprec_speed 14.1930ms 13.2926ms 75.2301 Ops/s 74.3429 Ops/s $\color{#35bf28}+1.19\%$
test_td3_speed 9.4627ms 8.3918ms 119.1635 Ops/s 121.2222 Ops/s $\color{#d91a1a}-1.70\%$
test_cql_speed 37.0927ms 35.8137ms 27.9223 Ops/s 24.6280 Ops/s $\textbf{\color{#35bf28}+13.38\%}$
test_a2c_speed 9.5493ms 7.5825ms 131.8819 Ops/s 132.2710 Ops/s $\color{#d91a1a}-0.29\%$
test_ppo_speed 9.7613ms 7.9803ms 125.3078 Ops/s 122.6167 Ops/s $\color{#35bf28}+2.19\%$
test_reinforce_speed 8.6184ms 6.9031ms 144.8623 Ops/s 139.3736 Ops/s $\color{#35bf28}+3.94\%$
test_iql_speed 34.4061ms 32.8365ms 30.4539 Ops/s 29.8749 Ops/s $\color{#35bf28}+1.94\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.5083ms 5.0001ms 199.9955 Ops/s 196.8977 Ops/s $\color{#35bf28}+1.57\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8336ms 0.4933ms 2.0273 KOps/s 1.9835 KOps/s $\color{#35bf28}+2.21\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6349ms 0.4586ms 2.1805 KOps/s 2.1643 KOps/s $\color{#35bf28}+0.75\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 8.0484ms 5.0539ms 197.8655 Ops/s 195.8551 Ops/s $\color{#35bf28}+1.03\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7050ms 0.4790ms 2.0878 KOps/s 2.0743 KOps/s $\color{#35bf28}+0.65\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6733ms 0.4565ms 2.1907 KOps/s 2.1923 KOps/s $\color{#d91a1a}-0.07\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.2694ms 1.7127ms 583.8884 Ops/s 580.9677 Ops/s $\color{#35bf28}+0.50\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.8307ms 1.6032ms 623.7406 Ops/s 612.8998 Ops/s $\color{#35bf28}+1.77\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.8012ms 5.2050ms 192.1247 Ops/s 190.7563 Ops/s $\color{#35bf28}+0.72\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.5930ms 0.6214ms 1.6094 KOps/s 1.5978 KOps/s $\color{#35bf28}+0.73\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9507ms 0.6099ms 1.6395 KOps/s 1.6577 KOps/s $\color{#d91a1a}-1.09\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.8281ms 5.1560ms 193.9480 Ops/s 195.9435 Ops/s $\color{#d91a1a}-1.02\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6939ms 0.4857ms 2.0587 KOps/s 1.9864 KOps/s $\color{#35bf28}+3.64\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 7.0830ms 0.4703ms 2.1263 KOps/s 2.0625 KOps/s $\color{#35bf28}+3.09\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.5032ms 5.0086ms 199.6579 Ops/s 201.0080 Ops/s $\color{#d91a1a}-0.67\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9064ms 0.4956ms 2.0179 KOps/s 2.0232 KOps/s $\color{#d91a1a}-0.26\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6305ms 0.4681ms 2.1361 KOps/s 2.1309 KOps/s $\color{#35bf28}+0.24\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.6428ms 5.1182ms 195.3825 Ops/s 188.7816 Ops/s $\color{#35bf28}+3.50\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.3201ms 0.6184ms 1.6170 KOps/s 1.5674 KOps/s $\color{#35bf28}+3.17\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8390ms 0.6012ms 1.6632 KOps/s 1.6768 KOps/s $\color{#d91a1a}-0.81\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1306s 6.3551ms 157.3539 Ops/s 158.4543 Ops/s $\color{#d91a1a}-0.69\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 0.1370s 15.8922ms 62.9238 Ops/s 76.5992 Ops/s $\textbf{\color{#d91a1a}-17.85\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 4.4003ms 1.1842ms 844.4321 Ops/s 808.4950 Ops/s $\color{#35bf28}+4.44\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1140s 6.0373ms 165.6382 Ops/s 164.0697 Ops/s $\color{#35bf28}+0.96\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.3968ms 12.9808ms 77.0370 Ops/s 65.3304 Ops/s $\textbf{\color{#35bf28}+17.92\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 4.4647ms 1.2016ms 832.2477 Ops/s 862.0504 Ops/s $\color{#d91a1a}-3.46\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1119s 6.1129ms 163.5896 Ops/s 154.4623 Ops/s $\textbf{\color{#35bf28}+5.91\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.6182ms 13.3318ms 75.0088 Ops/s 75.9237 Ops/s $\color{#d91a1a}-1.21\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.8594ms 1.2848ms 778.3454 Ops/s 752.7880 Ops/s $\color{#35bf28}+3.40\%$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}9$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1057s 0.1054s 9.4904 Ops/s 9.2883 Ops/s $\color{#35bf28}+2.17\%$
test_sync 95.0374ms 91.3569ms 10.9461 Ops/s 10.7913 Ops/s $\color{#35bf28}+1.43\%$
test_async 0.1672s 86.9625ms 11.4992 Ops/s 11.5751 Ops/s $\color{#d91a1a}-0.66\%$
test_single_pixels 0.1176s 0.1168s 8.5650 Ops/s 8.4496 Ops/s $\color{#35bf28}+1.36\%$
test_sync_pixels 77.3185ms 76.0313ms 13.1525 Ops/s 13.0294 Ops/s $\color{#35bf28}+0.94\%$
test_async_pixels 0.1442s 71.8553ms 13.9169 Ops/s 13.9788 Ops/s $\color{#d91a1a}-0.44\%$
test_simple 0.7765s 0.7746s 1.2911 Ops/s 1.2845 Ops/s $\color{#35bf28}+0.51\%$
test_transformed 1.0939s 1.0218s 0.9786 Ops/s 1.0056 Ops/s $\color{#d91a1a}-2.68\%$
test_serial 2.2153s 2.1336s 0.4687 Ops/s 0.4663 Ops/s $\color{#35bf28}+0.52\%$
test_parallel 1.9526s 1.9144s 0.5223 Ops/s 0.5188 Ops/s $\color{#35bf28}+0.69\%$
test_step_mdp_speed[True-True-True-True-True] 67.0220μs 37.4824μs 26.6792 KOps/s 25.5510 KOps/s $\color{#35bf28}+4.42\%$
test_step_mdp_speed[True-True-True-True-False] 45.3910μs 21.1028μs 47.3870 KOps/s 46.0981 KOps/s $\color{#35bf28}+2.80\%$
test_step_mdp_speed[True-True-True-False-True] 43.1610μs 20.7896μs 48.1009 KOps/s 46.0006 KOps/s $\color{#35bf28}+4.57\%$
test_step_mdp_speed[True-True-True-False-False] 26.8110μs 11.8798μs 84.1763 KOps/s 82.3803 KOps/s $\color{#35bf28}+2.18\%$
test_step_mdp_speed[True-True-False-True-True] 63.6610μs 39.3431μs 25.4174 KOps/s 24.1937 KOps/s $\textbf{\color{#35bf28}+5.06\%}$
test_step_mdp_speed[True-True-False-True-False] 41.4210μs 23.2099μs 43.0850 KOps/s 42.1876 KOps/s $\color{#35bf28}+2.13\%$
test_step_mdp_speed[True-True-False-False-True] 42.3610μs 22.9380μs 43.5957 KOps/s 40.7130 KOps/s $\textbf{\color{#35bf28}+7.08\%}$
test_step_mdp_speed[True-True-False-False-False] 33.2710μs 14.0531μs 71.1586 KOps/s 69.0755 KOps/s $\color{#35bf28}+3.02\%$
test_step_mdp_speed[True-False-True-True-True] 60.1220μs 41.3897μs 24.1606 KOps/s 22.6242 KOps/s $\textbf{\color{#35bf28}+6.79\%}$
test_step_mdp_speed[True-False-True-True-False] 42.6100μs 25.4723μs 39.2583 KOps/s 37.5551 KOps/s $\color{#35bf28}+4.54\%$
test_step_mdp_speed[True-False-True-False-True] 80.2620μs 22.8299μs 43.8022 KOps/s 40.5008 KOps/s $\textbf{\color{#35bf28}+8.15\%}$
test_step_mdp_speed[True-False-True-False-False] 30.6710μs 14.1570μs 70.6365 KOps/s 68.7649 KOps/s $\color{#35bf28}+2.72\%$
test_step_mdp_speed[True-False-False-True-True] 69.3420μs 44.0064μs 22.7240 KOps/s 21.6334 KOps/s $\textbf{\color{#35bf28}+5.04\%}$
test_step_mdp_speed[True-False-False-True-False] 52.0210μs 27.6952μs 36.1073 KOps/s 35.3551 KOps/s $\color{#35bf28}+2.13\%$
test_step_mdp_speed[True-False-False-False-True] 41.9410μs 24.8577μs 40.2290 KOps/s 37.4996 KOps/s $\textbf{\color{#35bf28}+7.28\%}$
test_step_mdp_speed[True-False-False-False-False] 38.5710μs 16.2353μs 61.5941 KOps/s 59.5493 KOps/s $\color{#35bf28}+3.43\%$
test_step_mdp_speed[False-True-True-True-True] 65.9610μs 42.0967μs 23.7548 KOps/s 22.7852 KOps/s $\color{#35bf28}+4.26\%$
test_step_mdp_speed[False-True-True-True-False] 43.8610μs 25.3129μs 39.5055 KOps/s 38.2877 KOps/s $\color{#35bf28}+3.18\%$
test_step_mdp_speed[False-True-True-False-True] 54.4110μs 27.4994μs 36.3645 KOps/s 34.4898 KOps/s $\textbf{\color{#35bf28}+5.44\%}$
test_step_mdp_speed[False-True-True-False-False] 40.5310μs 15.9201μs 62.8136 KOps/s 58.6021 KOps/s $\textbf{\color{#35bf28}+7.19\%}$
test_step_mdp_speed[False-True-False-True-True] 73.6620μs 44.4649μs 22.4896 KOps/s 21.5736 KOps/s $\color{#35bf28}+4.25\%$
test_step_mdp_speed[False-True-False-True-False] 49.2410μs 27.7118μs 36.0857 KOps/s 34.8211 KOps/s $\color{#35bf28}+3.63\%$
test_step_mdp_speed[False-True-False-False-True] 52.3010μs 29.8394μs 33.5128 KOps/s 32.3108 KOps/s $\color{#35bf28}+3.72\%$
test_step_mdp_speed[False-True-False-False-False] 46.4210μs 18.1601μs 55.0656 KOps/s 53.5509 KOps/s $\color{#35bf28}+2.83\%$
test_step_mdp_speed[False-False-True-True-True] 3.8890ms 46.7556μs 21.3878 KOps/s 20.4538 KOps/s $\color{#35bf28}+4.57\%$
test_step_mdp_speed[False-False-True-True-False] 47.6910μs 30.1663μs 33.1496 KOps/s 32.0777 KOps/s $\color{#35bf28}+3.34\%$
test_step_mdp_speed[False-False-True-False-True] 56.3210μs 29.6267μs 33.7533 KOps/s 32.5547 KOps/s $\color{#35bf28}+3.68\%$
test_step_mdp_speed[False-False-True-False-False] 36.1810μs 18.2666μs 54.7447 KOps/s 52.9189 KOps/s $\color{#35bf28}+3.45\%$
test_step_mdp_speed[False-False-False-True-True] 0.1767ms 47.9885μs 20.8383 KOps/s 20.1011 KOps/s $\color{#35bf28}+3.67\%$
test_step_mdp_speed[False-False-False-True-False] 57.3610μs 32.1003μs 31.1524 KOps/s 30.5154 KOps/s $\color{#35bf28}+2.09\%$
test_step_mdp_speed[False-False-False-False-True] 50.0910μs 31.4264μs 31.8204 KOps/s 30.4526 KOps/s $\color{#35bf28}+4.49\%$
test_step_mdp_speed[False-False-False-False-False] 67.6920μs 20.1604μs 49.6022 KOps/s 48.2915 KOps/s $\color{#35bf28}+2.71\%$
test_values[generalized_advantage_estimate-True-True] 24.9948ms 24.5053ms 40.8075 Ops/s 40.9899 Ops/s $\color{#d91a1a}-0.44\%$
test_values[vec_generalized_advantage_estimate-True-True] 89.8768ms 2.6953ms 371.0109 Ops/s 370.7678 Ops/s $\color{#35bf28}+0.07\%$
test_values[td0_return_estimate-False-False] 94.8220μs 65.2729μs 15.3203 KOps/s 15.2253 KOps/s $\color{#35bf28}+0.62\%$
test_values[td1_return_estimate-False-False] 55.4795ms 54.9715ms 18.1913 Ops/s 18.1994 Ops/s $\color{#d91a1a}-0.04\%$
test_values[vec_td1_return_estimate-False-False] 1.3260ms 1.0844ms 922.2020 Ops/s 917.6670 Ops/s $\color{#35bf28}+0.49\%$
test_values[td_lambda_return_estimate-True-False] 87.7609ms 87.1846ms 11.4699 Ops/s 11.0893 Ops/s $\color{#35bf28}+3.43\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.4217ms 1.0831ms 923.3056 Ops/s 916.3579 Ops/s $\color{#35bf28}+0.76\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 24.9345ms 24.7583ms 40.3904 Ops/s 40.0149 Ops/s $\color{#35bf28}+0.94\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9654ms 0.7184ms 1.3920 KOps/s 1.3850 KOps/s $\color{#35bf28}+0.50\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7477ms 0.6713ms 1.4896 KOps/s 1.4794 KOps/s $\color{#35bf28}+0.69\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5178ms 1.4675ms 681.4485 Ops/s 678.0900 Ops/s $\color{#35bf28}+0.50\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7277ms 0.6861ms 1.4575 KOps/s 1.4470 KOps/s $\color{#35bf28}+0.72\%$
test_dqn_speed 7.1292ms 1.3476ms 742.0628 Ops/s 718.5002 Ops/s $\color{#35bf28}+3.28\%$
test_ddpg_speed 2.8971ms 2.7356ms 365.5460 Ops/s 360.8772 Ops/s $\color{#35bf28}+1.29\%$
test_sac_speed 8.2494ms 7.8357ms 127.6204 Ops/s 125.7814 Ops/s $\color{#35bf28}+1.46\%$
test_redq_speed 12.0586ms 10.2794ms 97.2817 Ops/s 98.1698 Ops/s $\color{#d91a1a}-0.90\%$
test_redq_deprec_speed 11.0850ms 10.7978ms 92.6112 Ops/s 88.8168 Ops/s $\color{#35bf28}+4.27\%$
test_td3_speed 7.9241ms 7.7384ms 129.2264 Ops/s 126.2318 Ops/s $\color{#35bf28}+2.37\%$
test_cql_speed 25.6113ms 24.9068ms 40.1497 Ops/s 39.7098 Ops/s $\color{#35bf28}+1.11\%$
test_a2c_speed 5.7895ms 5.4804ms 182.4681 Ops/s 183.1291 Ops/s $\color{#d91a1a}-0.36\%$
test_ppo_speed 6.5287ms 5.8311ms 171.4953 Ops/s 171.5987 Ops/s $\color{#d91a1a}-0.06\%$
test_reinforce_speed 4.5803ms 4.3986ms 227.3435 Ops/s 218.9321 Ops/s $\color{#35bf28}+3.84\%$
test_iql_speed 19.9332ms 19.2554ms 51.9335 Ops/s 51.2421 Ops/s $\color{#35bf28}+1.35\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.7236ms 6.5209ms 153.3525 Ops/s 150.4495 Ops/s $\color{#35bf28}+1.93\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0390ms 0.5128ms 1.9500 KOps/s 1.9403 KOps/s $\color{#35bf28}+0.50\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6620ms 0.4933ms 2.0273 KOps/s 2.0183 KOps/s $\color{#35bf28}+0.44\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.7030ms 6.4524ms 154.9815 Ops/s 151.8722 Ops/s $\color{#35bf28}+2.05\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7947ms 0.5049ms 1.9806 KOps/s 1.9506 KOps/s $\color{#35bf28}+1.54\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6417ms 0.4863ms 2.0563 KOps/s 2.0479 KOps/s $\color{#35bf28}+0.41\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.1080ms 1.9513ms 512.4806 Ops/s 508.9519 Ops/s $\color{#35bf28}+0.69\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.0016ms 1.8602ms 537.5659 Ops/s 536.1928 Ops/s $\color{#35bf28}+0.26\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.8243ms 6.6261ms 150.9172 Ops/s 147.6442 Ops/s $\color{#35bf28}+2.22\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1254s 0.7705ms 1.2979 KOps/s 1.5034 KOps/s $\textbf{\color{#d91a1a}-13.67\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7790ms 0.6420ms 1.5576 KOps/s 1.5583 KOps/s $\color{#d91a1a}-0.04\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.6868ms 6.5273ms 153.2027 Ops/s 150.1331 Ops/s $\color{#35bf28}+2.04\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6212ms 0.5130ms 1.9492 KOps/s 1.9356 KOps/s $\color{#35bf28}+0.70\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.2643ms 0.4983ms 2.0068 KOps/s 2.0168 KOps/s $\color{#d91a1a}-0.49\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.6510ms 6.4346ms 155.4101 Ops/s 151.6784 Ops/s $\color{#35bf28}+2.46\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.1407s 0.7090ms 1.4104 KOps/s 1.9491 KOps/s $\textbf{\color{#d91a1a}-27.64\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6298ms 0.4885ms 2.0472 KOps/s 2.0445 KOps/s $\color{#35bf28}+0.13\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.7847ms 6.6650ms 150.0379 Ops/s 147.4159 Ops/s $\color{#35bf28}+1.78\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.0236ms 0.6636ms 1.5068 KOps/s 1.4991 KOps/s $\color{#35bf28}+0.51\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7952ms 0.6429ms 1.5554 KOps/s 1.5498 KOps/s $\color{#35bf28}+0.36\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1308s 7.6329ms 131.0119 Ops/s 126.8774 Ops/s $\color{#35bf28}+3.26\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 18.2091ms 15.7547ms 63.4730 Ops/s 61.1303 Ops/s $\color{#35bf28}+3.83\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.5688ms 1.3552ms 737.8755 Ops/s 269.2428 Ops/s $\textbf{\color{#35bf28}+174.06\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1246s 9.9309ms 100.6961 Ops/s 131.7656 Ops/s $\textbf{\color{#d91a1a}-23.58\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 18.0904ms 15.8161ms 63.2267 Ops/s 60.9366 Ops/s $\color{#35bf28}+3.76\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.1736ms 1.1563ms 864.8010 Ops/s 844.6062 Ops/s $\color{#35bf28}+2.39\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1257s 7.7408ms 129.1850 Ops/s 128.7419 Ops/s $\color{#35bf28}+0.34\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 18.3792ms 15.8562ms 63.0670 Ops/s 60.6099 Ops/s $\color{#35bf28}+4.05\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.0107ms 1.4965ms 668.2207 Ops/s 668.9877 Ops/s $\color{#d91a1a}-0.11\%$

@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Aug 13, 2024
@vmoens vmoens merged commit a4bb63b into main Aug 13, 2024
63 of 65 checks passed
@vmoens vmoens deleted the fix-ci branch August 13, 2024 18:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot