Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Doc] Fix links to tutos #2409

Merged
merged 2 commits into from
Sep 2, 2024
Merged

[Doc] Fix links to tutos #2409

merged 2 commits into from
Sep 2, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Sep 2, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Sep 2, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2409

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (21 Unrelated Failures)

As of commit 74868ee with merge base e82a69f (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 2, 2024
@vmoens vmoens added the documentation Improvements or additions to documentation label Sep 2, 2024
@vmoens vmoens merged commit ca6eae4 into main Sep 2, 2024
22 of 23 checks passed
@vmoens vmoens deleted the vmoens-patch-1 branch September 2, 2024 14:43
@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 2, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}12$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 63.1998ms 62.7195ms 15.9440 Ops/s 16.0657 Ops/s $\color{#d91a1a}-0.76\%$
test_sync 48.9937ms 35.9723ms 27.7992 Ops/s 27.6423 Ops/s $\color{#35bf28}+0.57\%$
test_async 54.6837ms 31.7926ms 31.4539 Ops/s 31.5657 Ops/s $\color{#d91a1a}-0.35\%$
test_simple 0.5181s 0.4331s 2.3092 Ops/s 2.2602 Ops/s $\color{#35bf28}+2.17\%$
test_transformed 0.6835s 0.6003s 1.6660 Ops/s 1.6588 Ops/s $\color{#35bf28}+0.44\%$
test_serial 1.3790s 1.3114s 0.7626 Ops/s 0.7509 Ops/s $\color{#35bf28}+1.56\%$
test_parallel 1.2167s 1.1360s 0.8803 Ops/s 0.8786 Ops/s $\color{#35bf28}+0.19\%$
test_step_mdp_speed[True-True-True-True-True] 0.2533ms 26.8139μs 37.2941 KOps/s 38.0842 KOps/s $\color{#d91a1a}-2.07\%$
test_step_mdp_speed[True-True-True-True-False] 46.7670μs 15.3650μs 65.0829 KOps/s 64.8773 KOps/s $\color{#35bf28}+0.32\%$
test_step_mdp_speed[True-True-True-False-True] 76.9840μs 15.2931μs 65.3888 KOps/s 66.6098 KOps/s $\color{#d91a1a}-1.83\%$
test_step_mdp_speed[True-True-True-False-False] 37.9110μs 8.8943μs 112.4318 KOps/s 112.5302 KOps/s $\color{#d91a1a}-0.09\%$
test_step_mdp_speed[True-True-False-True-True] 79.2080μs 28.4462μs 35.1541 KOps/s 35.2556 KOps/s $\color{#d91a1a}-0.29\%$
test_step_mdp_speed[True-True-False-True-False] 51.6970μs 17.1564μs 58.2873 KOps/s 58.2069 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[True-True-False-False-True] 54.3810μs 16.7236μs 59.7958 KOps/s 60.5114 KOps/s $\color{#d91a1a}-1.18\%$
test_step_mdp_speed[True-True-False-False-False] 42.2790μs 10.3985μs 96.1674 KOps/s 97.0559 KOps/s $\color{#d91a1a}-0.92\%$
test_step_mdp_speed[True-False-True-True-True] 75.2900μs 29.7898μs 33.5685 KOps/s 33.5280 KOps/s $\color{#35bf28}+0.12\%$
test_step_mdp_speed[True-False-True-True-False] 57.5380μs 18.6474μs 53.6268 KOps/s 53.4754 KOps/s $\color{#35bf28}+0.28\%$
test_step_mdp_speed[True-False-True-False-True] 46.3370μs 16.7899μs 59.5598 KOps/s 60.1948 KOps/s $\color{#d91a1a}-1.06\%$
test_step_mdp_speed[True-False-True-False-False] 58.1890μs 10.5106μs 95.1418 KOps/s 97.1921 KOps/s $\color{#d91a1a}-2.11\%$
test_step_mdp_speed[True-False-False-True-True] 61.8450μs 31.4168μs 31.8301 KOps/s 32.0569 KOps/s $\color{#d91a1a}-0.71\%$
test_step_mdp_speed[True-False-False-True-False] 47.6890μs 20.2174μs 49.4624 KOps/s 49.7635 KOps/s $\color{#d91a1a}-0.61\%$
test_step_mdp_speed[True-False-False-False-True] 48.9420μs 18.3015μs 54.6402 KOps/s 55.4305 KOps/s $\color{#d91a1a}-1.43\%$
test_step_mdp_speed[True-False-False-False-False] 49.2620μs 11.9970μs 83.3540 KOps/s 84.6011 KOps/s $\color{#d91a1a}-1.47\%$
test_step_mdp_speed[False-True-True-True-True] 69.9100μs 30.0982μs 33.2245 KOps/s 33.8184 KOps/s $\color{#d91a1a}-1.76\%$
test_step_mdp_speed[False-True-True-True-False] 63.6680μs 18.8537μs 53.0401 KOps/s 53.7148 KOps/s $\color{#d91a1a}-1.26\%$
test_step_mdp_speed[False-True-True-False-True] 51.2660μs 19.2455μs 51.9601 KOps/s 53.4152 KOps/s $\color{#d91a1a}-2.72\%$
test_step_mdp_speed[False-True-True-False-False] 56.7860μs 11.6408μs 85.9045 KOps/s 86.6597 KOps/s $\color{#d91a1a}-0.87\%$
test_step_mdp_speed[False-True-False-True-True] 72.1650μs 31.4437μs 31.8029 KOps/s 31.9740 KOps/s $\color{#d91a1a}-0.54\%$
test_step_mdp_speed[False-True-False-True-False] 57.2960μs 20.5103μs 48.7560 KOps/s 49.2049 KOps/s $\color{#d91a1a}-0.91\%$
test_step_mdp_speed[False-True-False-False-True] 67.9270μs 21.0729μs 47.4544 KOps/s 48.0049 KOps/s $\color{#d91a1a}-1.15\%$
test_step_mdp_speed[False-True-False-False-False] 48.4210μs 13.1547μs 76.0182 KOps/s 76.4553 KOps/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[False-False-True-True-True] 3.7699ms 32.9492μs 30.3497 KOps/s 30.5706 KOps/s $\color{#d91a1a}-0.72\%$
test_step_mdp_speed[False-False-True-True-False] 54.2410μs 21.7082μs 46.0655 KOps/s 45.5251 KOps/s $\color{#35bf28}+1.19\%$
test_step_mdp_speed[False-False-True-False-True] 70.6820μs 21.1786μs 47.2175 KOps/s 47.3390 KOps/s $\color{#d91a1a}-0.26\%$
test_step_mdp_speed[False-False-True-False-False] 47.4190μs 13.2234μs 75.6234 KOps/s 75.9471 KOps/s $\color{#d91a1a}-0.43\%$
test_step_mdp_speed[False-False-False-True-True] 82.9650μs 34.2579μs 29.1903 KOps/s 29.4298 KOps/s $\color{#d91a1a}-0.81\%$
test_step_mdp_speed[False-False-False-True-False] 67.9670μs 23.0040μs 43.4708 KOps/s 43.6780 KOps/s $\color{#d91a1a}-0.47\%$
test_step_mdp_speed[False-False-False-False-True] 76.3830μs 21.9277μs 45.6044 KOps/s 46.2246 KOps/s $\color{#d91a1a}-1.34\%$
test_step_mdp_speed[False-False-False-False-False] 49.4720μs 14.4009μs 69.4403 KOps/s 68.3331 KOps/s $\color{#35bf28}+1.62\%$
test_values[generalized_advantage_estimate-True-True] 10.6864ms 9.7616ms 102.4420 Ops/s 96.9267 Ops/s $\textbf{\color{#35bf28}+5.69\%}$
test_values[vec_generalized_advantage_estimate-True-True] 41.5655ms 36.0166ms 27.7650 Ops/s 29.3592 Ops/s $\textbf{\color{#d91a1a}-5.43\%}$
test_values[td0_return_estimate-False-False] 0.2457ms 0.1896ms 5.2750 KOps/s 5.0038 KOps/s $\textbf{\color{#35bf28}+5.42\%}$
test_values[td1_return_estimate-False-False] 27.1703ms 24.0060ms 41.6562 Ops/s 39.6222 Ops/s $\textbf{\color{#35bf28}+5.13\%}$
test_values[vec_td1_return_estimate-False-False] 39.3537ms 35.9950ms 27.7817 Ops/s 29.6417 Ops/s $\textbf{\color{#d91a1a}-6.28\%}$
test_values[td_lambda_return_estimate-True-False] 36.6129ms 34.3484ms 29.1134 Ops/s 27.4941 Ops/s $\textbf{\color{#35bf28}+5.89\%}$
test_values[vec_td_lambda_return_estimate-True-False] 39.2004ms 36.0906ms 27.7080 Ops/s 29.4178 Ops/s $\textbf{\color{#d91a1a}-5.81\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.4808ms 8.2433ms 121.3101 Ops/s 116.0290 Ops/s $\color{#35bf28}+4.55\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.4054ms 1.8910ms 528.8112 Ops/s 533.4255 Ops/s $\color{#d91a1a}-0.87\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.6224ms 0.3646ms 2.7429 KOps/s 2.7540 KOps/s $\color{#d91a1a}-0.40\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 50.4750ms 46.7804ms 21.3765 Ops/s 20.6822 Ops/s $\color{#35bf28}+3.36\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 4.4051ms 3.1026ms 322.3055 Ops/s 323.0830 Ops/s $\color{#d91a1a}-0.24\%$
test_dqn_speed 1.4241ms 1.2963ms 771.4251 Ops/s 762.3980 Ops/s $\color{#35bf28}+1.18\%$
test_ddpg_speed 3.4556ms 2.7103ms 368.9620 Ops/s 367.7552 Ops/s $\color{#35bf28}+0.33\%$
test_sac_speed 8.7896ms 8.0612ms 124.0511 Ops/s 124.8288 Ops/s $\color{#d91a1a}-0.62\%$
test_redq_speed 14.0013ms 13.4109ms 74.5660 Ops/s 76.7914 Ops/s $\color{#d91a1a}-2.90\%$
test_redq_deprec_speed 22.0120ms 13.5184ms 73.9733 Ops/s 72.1694 Ops/s $\color{#35bf28}+2.50\%$
test_td3_speed 8.8303ms 8.3645ms 119.5529 Ops/s 119.3934 Ops/s $\color{#35bf28}+0.13\%$
test_cql_speed 37.1199ms 35.5957ms 28.0933 Ops/s 26.7077 Ops/s $\textbf{\color{#35bf28}+5.19\%}$
test_a2c_speed 8.0486ms 7.3325ms 136.3796 Ops/s 124.9749 Ops/s $\textbf{\color{#35bf28}+9.13\%}$
test_ppo_speed 8.8197ms 7.6154ms 131.3127 Ops/s 119.7114 Ops/s $\textbf{\color{#35bf28}+9.69\%}$
test_reinforce_speed 7.2952ms 6.5657ms 152.3059 Ops/s 141.9786 Ops/s $\textbf{\color{#35bf28}+7.27\%}$
test_iql_speed 35.0875ms 33.1192ms 30.1939 Ops/s 29.8629 Ops/s $\color{#35bf28}+1.11\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.3096ms 5.1029ms 195.9672 Ops/s 190.9008 Ops/s $\color{#35bf28}+2.65\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.5177ms 0.5265ms 1.8995 KOps/s 1.9991 KOps/s $\color{#d91a1a}-4.98\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6539ms 0.4666ms 2.1430 KOps/s 2.1011 KOps/s $\color{#35bf28}+1.99\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 10.2066ms 5.0587ms 197.6792 Ops/s 198.2837 Ops/s $\color{#d91a1a}-0.30\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8346ms 0.5037ms 1.9852 KOps/s 1.9091 KOps/s $\color{#35bf28}+3.99\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7224ms 0.4672ms 2.1403 KOps/s 2.1092 KOps/s $\color{#35bf28}+1.47\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.7116ms 1.7811ms 561.4534 Ops/s 582.8418 Ops/s $\color{#d91a1a}-3.67\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.2016ms 1.6327ms 612.4816 Ops/s 606.5614 Ops/s $\color{#35bf28}+0.98\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.8284ms 5.5003ms 181.8089 Ops/s 193.0488 Ops/s $\textbf{\color{#d91a1a}-5.82\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1797ms 0.6497ms 1.5392 KOps/s 1.5664 KOps/s $\color{#d91a1a}-1.74\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9195ms 0.6358ms 1.5729 KOps/s 1.5924 KOps/s $\color{#d91a1a}-1.22\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.8389ms 5.4121ms 184.7722 Ops/s 200.3581 Ops/s $\textbf{\color{#d91a1a}-7.78\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.5345ms 0.5114ms 1.9553 KOps/s 2.0060 KOps/s $\color{#d91a1a}-2.53\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7684ms 0.4847ms 2.0630 KOps/s 2.0931 KOps/s $\color{#d91a1a}-1.44\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 7.8339ms 5.1513ms 194.1256 Ops/s 203.2135 Ops/s $\color{#d91a1a}-4.47\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.1537s 0.7082ms 1.4121 KOps/s 2.0129 KOps/s $\textbf{\color{#d91a1a}-29.85\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7202ms 0.4781ms 2.0917 KOps/s 2.1608 KOps/s $\color{#d91a1a}-3.20\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.0281ms 5.4242ms 184.3580 Ops/s 192.9392 Ops/s $\color{#d91a1a}-4.45\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8958ms 0.6580ms 1.5198 KOps/s 1.5239 KOps/s $\color{#d91a1a}-0.27\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 7.5798ms 0.6278ms 1.5928 KOps/s 1.6460 KOps/s $\color{#d91a1a}-3.23\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1387s 6.8557ms 145.8645 Ops/s 151.9043 Ops/s $\color{#d91a1a}-3.98\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 0.1388s 16.1377ms 61.9665 Ops/s 73.4324 Ops/s $\textbf{\color{#d91a1a}-15.61\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.2107ms 1.3231ms 755.7732 Ops/s 814.8509 Ops/s $\textbf{\color{#d91a1a}-7.25\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1275s 6.5702ms 152.2017 Ops/s 110.5047 Ops/s $\textbf{\color{#35bf28}+37.73\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 19.1415ms 13.3759ms 74.7611 Ops/s 71.7889 Ops/s $\color{#35bf28}+4.14\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.2281ms 1.3505ms 740.4443 Ops/s 752.5261 Ops/s $\color{#d91a1a}-1.61\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1227s 6.4737ms 154.4722 Ops/s 138.3454 Ops/s $\textbf{\color{#35bf28}+11.66\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.9495ms 13.4867ms 74.1473 Ops/s 69.9803 Ops/s $\textbf{\color{#35bf28}+5.95\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.8991ms 1.3821ms 723.5275 Ops/s 651.7405 Ops/s $\textbf{\color{#35bf28}+11.01\%}$

@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 2, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}8$. Worsened: $\large\color{#d91a1a}10$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1038s 0.1027s 9.7327 Ops/s 9.8956 Ops/s $\color{#d91a1a}-1.65\%$
test_sync 91.9366ms 88.7761ms 11.2643 Ops/s 11.2608 Ops/s $\color{#35bf28}+0.03\%$
test_async 0.1757s 84.8370ms 11.7873 Ops/s 11.9330 Ops/s $\color{#d91a1a}-1.22\%$
test_single_pixels 0.1090s 0.1084s 9.2253 Ops/s 9.2632 Ops/s $\color{#d91a1a}-0.41\%$
test_sync_pixels 82.1115ms 71.8527ms 13.9174 Ops/s 13.8653 Ops/s $\color{#35bf28}+0.38\%$
test_async_pixels 0.2180s 68.1619ms 14.6709 Ops/s 14.8383 Ops/s $\color{#d91a1a}-1.13\%$
test_simple 0.8278s 0.7584s 1.3186 Ops/s 1.3524 Ops/s $\color{#d91a1a}-2.50\%$
test_transformed 1.0709s 0.9933s 1.0067 Ops/s 1.0569 Ops/s $\color{#d91a1a}-4.74\%$
test_serial 2.1878s 2.1030s 0.4755 Ops/s 0.4935 Ops/s $\color{#d91a1a}-3.64\%$
test_parallel 1.9028s 1.8817s 0.5314 Ops/s 0.5423 Ops/s $\color{#d91a1a}-2.00\%$
test_step_mdp_speed[True-True-True-True-True] 0.2421ms 36.5940μs 27.3269 KOps/s 27.8317 KOps/s $\color{#d91a1a}-1.81\%$
test_step_mdp_speed[True-True-True-True-False] 0.2145ms 20.7917μs 48.0961 KOps/s 47.8178 KOps/s $\color{#35bf28}+0.58\%$
test_step_mdp_speed[True-True-True-False-True] 0.2121ms 20.4430μs 48.9164 KOps/s 48.8906 KOps/s $\color{#35bf28}+0.05\%$
test_step_mdp_speed[True-True-True-False-False] 41.6710μs 11.7190μs 85.3315 KOps/s 83.7552 KOps/s $\color{#35bf28}+1.88\%$
test_step_mdp_speed[True-True-False-True-True] 0.2198ms 38.3152μs 26.0993 KOps/s 26.0760 KOps/s $\color{#35bf28}+0.09\%$
test_step_mdp_speed[True-True-False-True-False] 64.8320μs 22.8043μs 43.8514 KOps/s 43.1714 KOps/s $\color{#35bf28}+1.58\%$
test_step_mdp_speed[True-True-False-False-True] 51.2010μs 22.4628μs 44.5181 KOps/s 44.7088 KOps/s $\color{#d91a1a}-0.43\%$
test_step_mdp_speed[True-True-False-False-False] 42.6900μs 13.7905μs 72.5138 KOps/s 72.0427 KOps/s $\color{#35bf28}+0.65\%$
test_step_mdp_speed[True-False-True-True-True] 73.5910μs 40.5901μs 24.6366 KOps/s 24.6309 KOps/s $\color{#35bf28}+0.02\%$
test_step_mdp_speed[True-False-True-True-False] 55.9210μs 24.5146μs 40.7920 KOps/s 39.6338 KOps/s $\color{#35bf28}+2.92\%$
test_step_mdp_speed[True-False-True-False-True] 46.6310μs 22.3581μs 44.7266 KOps/s 44.7034 KOps/s $\color{#35bf28}+0.05\%$
test_step_mdp_speed[True-False-True-False-False] 40.9210μs 13.6947μs 73.0208 KOps/s 72.4631 KOps/s $\color{#35bf28}+0.77\%$
test_step_mdp_speed[True-False-False-True-True] 70.4220μs 41.9215μs 23.8541 KOps/s 23.5270 KOps/s $\color{#35bf28}+1.39\%$
test_step_mdp_speed[True-False-False-True-False] 55.1510μs 26.8606μs 37.2293 KOps/s 36.9275 KOps/s $\color{#35bf28}+0.82\%$
test_step_mdp_speed[True-False-False-False-True] 59.0420μs 24.1403μs 41.4245 KOps/s 41.4100 KOps/s $\color{#35bf28}+0.04\%$
test_step_mdp_speed[True-False-False-False-False] 0.1433ms 15.4819μs 64.5915 KOps/s 63.2884 KOps/s $\color{#35bf28}+2.06\%$
test_step_mdp_speed[False-True-True-True-True] 80.5320μs 40.0243μs 24.9848 KOps/s 24.4548 KOps/s $\color{#35bf28}+2.17\%$
test_step_mdp_speed[False-True-True-True-False] 56.5810μs 24.5967μs 40.6558 KOps/s 39.2813 KOps/s $\color{#35bf28}+3.50\%$
test_step_mdp_speed[False-True-True-False-True] 52.6010μs 25.5034μs 39.2104 KOps/s 38.2591 KOps/s $\color{#35bf28}+2.49\%$
test_step_mdp_speed[False-True-True-False-False] 44.1410μs 15.3540μs 65.1297 KOps/s 63.9390 KOps/s $\color{#35bf28}+1.86\%$
test_step_mdp_speed[False-True-False-True-True] 73.9410μs 42.3841μs 23.5937 KOps/s 23.3900 KOps/s $\color{#35bf28}+0.87\%$
test_step_mdp_speed[False-True-False-True-False] 54.0610μs 27.0533μs 36.9641 KOps/s 36.7926 KOps/s $\color{#35bf28}+0.47\%$
test_step_mdp_speed[False-True-False-False-True] 0.1321ms 27.9055μs 35.8352 KOps/s 35.6141 KOps/s $\color{#35bf28}+0.62\%$
test_step_mdp_speed[False-True-False-False-False] 58.0510μs 17.3201μs 57.7363 KOps/s 56.9609 KOps/s $\color{#35bf28}+1.36\%$
test_step_mdp_speed[False-False-True-True-True] 4.7173ms 44.7041μs 22.3693 KOps/s 22.0529 KOps/s $\color{#35bf28}+1.43\%$
test_step_mdp_speed[False-False-True-True-False] 57.6820μs 29.2447μs 34.1942 KOps/s 33.7769 KOps/s $\color{#35bf28}+1.24\%$
test_step_mdp_speed[False-False-True-False-True] 56.9920μs 27.5779μs 36.2609 KOps/s 35.6033 KOps/s $\color{#35bf28}+1.85\%$
test_step_mdp_speed[False-False-True-False-False] 46.0510μs 17.4688μs 57.2450 KOps/s 56.5112 KOps/s $\color{#35bf28}+1.30\%$
test_step_mdp_speed[False-False-False-True-True] 76.9020μs 45.7915μs 21.8381 KOps/s 21.5967 KOps/s $\color{#35bf28}+1.12\%$
test_step_mdp_speed[False-False-False-True-False] 87.0220μs 30.9865μs 32.2722 KOps/s 31.8565 KOps/s $\color{#35bf28}+1.30\%$
test_step_mdp_speed[False-False-False-False-True] 66.8220μs 29.6566μs 33.7194 KOps/s 33.3168 KOps/s $\color{#35bf28}+1.21\%$
test_step_mdp_speed[False-False-False-False-False] 0.1952ms 19.3803μs 51.5987 KOps/s 50.9544 KOps/s $\color{#35bf28}+1.26\%$
test_values[generalized_advantage_estimate-True-True] 25.4295ms 23.9213ms 41.8038 Ops/s 42.3707 Ops/s $\color{#d91a1a}-1.34\%$
test_values[vec_generalized_advantage_estimate-True-True] 0.1046s 2.9826ms 335.2822 Ops/s 326.7628 Ops/s $\color{#35bf28}+2.61\%$
test_values[td0_return_estimate-False-False] 89.7420μs 65.6075μs 15.2422 KOps/s 15.5387 KOps/s $\color{#d91a1a}-1.91\%$
test_values[td1_return_estimate-False-False] 57.1352ms 53.5713ms 18.6667 Ops/s 19.0051 Ops/s $\color{#d91a1a}-1.78\%$
test_values[vec_td1_return_estimate-False-False] 1.4059ms 1.0634ms 940.3379 Ops/s 935.6506 Ops/s $\color{#35bf28}+0.50\%$
test_values[td_lambda_return_estimate-True-False] 91.3535ms 87.0615ms 11.4861 Ops/s 11.8907 Ops/s $\color{#d91a1a}-3.40\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.4122ms 1.0567ms 946.3004 Ops/s 942.8848 Ops/s $\color{#35bf28}+0.36\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.4536ms 24.0377ms 41.6014 Ops/s 43.0288 Ops/s $\color{#d91a1a}-3.32\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.9942ms 0.7127ms 1.4032 KOps/s 1.4169 KOps/s $\color{#d91a1a}-0.97\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.8265ms 0.6488ms 1.5413 KOps/s 1.5300 KOps/s $\color{#35bf28}+0.74\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.6189ms 1.4553ms 687.1353 Ops/s 691.0142 Ops/s $\color{#d91a1a}-0.56\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.8915ms 0.6651ms 1.5035 KOps/s 1.5114 KOps/s $\color{#d91a1a}-0.52\%$
test_dqn_speed 1.5213ms 1.2876ms 776.6467 Ops/s 782.1671 Ops/s $\color{#d91a1a}-0.71\%$
test_ddpg_speed 2.7921ms 2.5978ms 384.9419 Ops/s 382.4708 Ops/s $\color{#35bf28}+0.65\%$
test_sac_speed 7.9224ms 7.5588ms 132.2957 Ops/s 132.2861 Ops/s $+0.01\%$
test_redq_speed 10.9527ms 10.1201ms 98.8129 Ops/s 96.9326 Ops/s $\color{#35bf28}+1.94\%$
test_redq_deprec_speed 11.1002ms 10.5990ms 94.3485 Ops/s 97.1928 Ops/s $\color{#d91a1a}-2.93\%$
test_td3_speed 7.8223ms 7.6115ms 131.3801 Ops/s 130.6333 Ops/s $\color{#35bf28}+0.57\%$
test_cql_speed 28.3988ms 25.3479ms 39.4510 Ops/s 39.4308 Ops/s $\color{#35bf28}+0.05\%$
test_a2c_speed 5.7441ms 5.4867ms 182.2587 Ops/s 186.6531 Ops/s $\color{#d91a1a}-2.35\%$
test_ppo_speed 6.0670ms 5.7633ms 173.5128 Ops/s 176.1833 Ops/s $\color{#d91a1a}-1.52\%$
test_reinforce_speed 5.4332ms 4.5669ms 218.9665 Ops/s 219.7835 Ops/s $\color{#d91a1a}-0.37\%$
test_iql_speed 22.1795ms 19.4388ms 51.4434 Ops/s 51.8888 Ops/s $\color{#d91a1a}-0.86\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.6007ms 6.3749ms 156.8663 Ops/s 157.9531 Ops/s $\color{#d91a1a}-0.69\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.1165s 0.3777ms 2.6479 KOps/s 2.9028 KOps/s $\textbf{\color{#d91a1a}-8.78\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5324ms 0.3105ms 3.2202 KOps/s 3.0487 KOps/s $\textbf{\color{#35bf28}+5.63\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.6989ms 6.2994ms 158.7460 Ops/s 158.1343 Ops/s $\color{#35bf28}+0.39\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7628ms 0.3249ms 3.0780 KOps/s 4.2514 KOps/s $\textbf{\color{#d91a1a}-27.60\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6380ms 0.3061ms 3.2667 KOps/s 4.6843 KOps/s $\textbf{\color{#d91a1a}-30.26\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.9223ms 1.4876ms 672.2168 Ops/s 748.7023 Ops/s $\textbf{\color{#d91a1a}-10.22\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5901ms 1.3837ms 722.6778 Ops/s 802.3995 Ops/s $\textbf{\color{#d91a1a}-9.94\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.6460ms 6.4388ms 155.3085 Ops/s 154.4970 Ops/s $\color{#35bf28}+0.53\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0429ms 0.3982ms 2.5113 KOps/s 2.0967 KOps/s $\textbf{\color{#35bf28}+19.77\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6627ms 0.3684ms 2.7141 KOps/s 2.1735 KOps/s $\textbf{\color{#35bf28}+24.87\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.6149ms 6.4135ms 155.9209 Ops/s 157.8637 Ops/s $\color{#d91a1a}-1.23\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.6672ms 0.2408ms 4.1531 KOps/s 2.8997 KOps/s $\textbf{\color{#35bf28}+43.23\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.4159ms 0.2362ms 4.2336 KOps/s 2.9782 KOps/s $\textbf{\color{#35bf28}+42.15\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.7739ms 6.2969ms 158.8093 Ops/s 160.0986 Ops/s $\color{#d91a1a}-0.81\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.1756s 0.5122ms 1.9525 KOps/s 4.2417 KOps/s $\textbf{\color{#d91a1a}-53.97\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5050ms 0.3076ms 3.2514 KOps/s 4.6727 KOps/s $\textbf{\color{#d91a1a}-30.42\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.8299ms 6.4957ms 153.9474 Ops/s 154.3869 Ops/s $\color{#d91a1a}-0.28\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8916ms 0.4711ms 2.1226 KOps/s 2.5667 KOps/s $\textbf{\color{#d91a1a}-17.30\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6418ms 0.4497ms 2.2235 KOps/s 2.7149 KOps/s $\textbf{\color{#d91a1a}-18.10\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1699s 8.4381ms 118.5107 Ops/s 118.8965 Ops/s $\color{#d91a1a}-0.32\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 22.0264ms 16.0606ms 62.2643 Ops/s 54.1107 Ops/s $\textbf{\color{#35bf28}+15.07\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.0786ms 0.9933ms 1.0067 KOps/s 906.6993 Ops/s $\textbf{\color{#35bf28}+11.03\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1371s 10.2407ms 97.6500 Ops/s 128.3182 Ops/s $\textbf{\color{#d91a1a}-23.90\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 21.1069ms 16.0176ms 62.4314 Ops/s 63.8761 Ops/s $\color{#d91a1a}-2.26\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 2.3141ms 1.0321ms 968.8601 Ops/s 847.4027 Ops/s $\textbf{\color{#35bf28}+14.33\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1363s 7.8782ms 126.9325 Ops/s 127.8537 Ops/s $\color{#d91a1a}-0.72\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 21.5317ms 16.2211ms 61.6483 Ops/s 63.0895 Ops/s $\color{#d91a1a}-2.28\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.7481ms 1.3253ms 754.5591 Ops/s 755.9358 Ops/s $\color{#d91a1a}-0.18\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot