[CI] Fix CI

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/1711

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (3 Unrelated Failures)

As of commit 022a04c with merge base bc7595f ():

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

• Unit-tests on Linux CPU / tests (3.9) / linux-job (gh)
• Unit-tests on Linux GPU, latest stable release / tests (3.8, 11.8) / linux-job (gh)

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Habitat Tests on Linux / tests (3.9, 11.6) / linux-job (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 89. Improved: $\large\color{#35bf28}3$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	63.8351ms	63.5286ms	15.7409 Ops/s	15.2995 Ops/s	$\color{#35bf28}+2.89\%$
test_sync	39.3042ms	34.7841ms	28.7488 Ops/s	29.4786 Ops/s	$\color{#d91a1a}-2.48\%$
test_async	65.2868ms	32.5333ms	30.7378 Ops/s	30.9586 Ops/s	$\color{#d91a1a}-0.71\%$
test_simple	0.4848s	0.4316s	2.3168 Ops/s	2.3281 Ops/s	$\color{#d91a1a}-0.49\%$
test_transformed	0.6470s	0.6008s	1.6644 Ops/s	1.6641 Ops/s	$\color{#35bf28}+0.02\%$
test_serial	1.3572s	1.3150s	0.7604 Ops/s	0.7555 Ops/s	$\color{#35bf28}+0.66\%$
test_parallel	1.3893s	1.3422s	0.7450 Ops/s	0.7374 Ops/s	$\color{#35bf28}+1.03\%$
test_step_mdp_speed[True-True-True-True-True]	0.1178ms	22.4839μs	44.4764 KOps/s	43.8330 KOps/s	$\color{#35bf28}+1.47\%$
test_step_mdp_speed[True-True-True-True-False]	36.8990μs	13.6724μs	73.1400 KOps/s	72.5828 KOps/s	$\color{#35bf28}+0.77\%$
test_step_mdp_speed[True-True-True-False-True]	46.3670μs	13.7046μs	72.9683 KOps/s	70.8170 KOps/s	$\color{#35bf28}+3.04\%$
test_step_mdp_speed[True-True-True-False-False]	27.3710μs	8.2665μs	120.9702 KOps/s	120.0186 KOps/s	$\color{#35bf28}+0.79\%$
test_step_mdp_speed[True-True-False-True-True]	50.5250μs	24.0007μs	41.6655 KOps/s	40.7146 KOps/s	$\color{#35bf28}+2.34\%$
test_step_mdp_speed[True-True-False-True-False]	72.3550μs	15.1141μs	66.1635 KOps/s	64.8079 KOps/s	$\color{#35bf28}+2.09\%$
test_step_mdp_speed[True-True-False-False-True]	59.5710μs	14.9239μs	67.0066 KOps/s	66.2538 KOps/s	$\color{#35bf28}+1.14\%$
test_step_mdp_speed[True-True-False-False-False]	50.0530μs	9.6316μs	103.8246 KOps/s	104.1122 KOps/s	$\color{#d91a1a}-0.28\%$
test_step_mdp_speed[True-False-True-True-True]	71.4440μs	25.3427μs	39.4591 KOps/s	39.2301 KOps/s	$\color{#35bf28}+0.58\%$
test_step_mdp_speed[True-False-True-True-False]	40.6660μs	16.3871μs	61.0236 KOps/s	61.4188 KOps/s	$\color{#d91a1a}-0.64\%$
test_step_mdp_speed[True-False-True-False-True]	43.6710μs	15.1736μs	65.9037 KOps/s	65.6499 KOps/s	$\color{#35bf28}+0.39\%$
test_step_mdp_speed[True-False-True-False-False]	59.9020μs	9.6935μs	103.1624 KOps/s	104.0789 KOps/s	$\color{#d91a1a}-0.88\%$
test_step_mdp_speed[True-False-False-True-True]	55.7740μs	27.0792μs	36.9288 KOps/s	37.4732 KOps/s	$\color{#d91a1a}-1.45\%$
test_step_mdp_speed[True-False-False-True-False]	42.0290μs	17.6946μs	56.5145 KOps/s	57.1350 KOps/s	$\color{#d91a1a}-1.09\%$
test_step_mdp_speed[True-False-False-False-True]	40.3160μs	16.5207μs	60.5302 KOps/s	61.7127 KOps/s	$\color{#d91a1a}-1.92\%$
test_step_mdp_speed[True-False-False-False-False]	37.0300μs	10.8798μs	91.9137 KOps/s	92.4378 KOps/s	$\color{#d91a1a}-0.57\%$
test_step_mdp_speed[False-True-True-True-True]	55.7150μs	25.5296μs	39.1703 KOps/s	39.1741 KOps/s	$-0.01\%$
test_step_mdp_speed[False-True-True-True-False]	45.4750μs	16.3403μs	61.1984 KOps/s	60.4884 KOps/s	$\color{#35bf28}+1.17\%$
test_step_mdp_speed[False-True-True-False-True]	58.6290μs	17.4735μs	57.2294 KOps/s	57.3454 KOps/s	$\color{#d91a1a}-0.20\%$
test_step_mdp_speed[False-True-True-False-False]	34.8960μs	10.7815μs	92.7516 KOps/s	91.0750 KOps/s	$\color{#35bf28}+1.84\%$
test_step_mdp_speed[False-True-False-True-True]	73.1670μs	26.3343μs	37.9733 KOps/s	37.7463 KOps/s	$\color{#35bf28}+0.60\%$
test_step_mdp_speed[False-True-False-True-False]	70.1420μs	17.3390μs	57.6733 KOps/s	56.7017 KOps/s	$\color{#35bf28}+1.71\%$
test_step_mdp_speed[False-True-False-False-True]	59.5910μs	18.4198μs	54.2895 KOps/s	53.7994 KOps/s	$\color{#35bf28}+0.91\%$
test_step_mdp_speed[False-True-False-False-False]	32.9040μs	11.9461μs	83.7095 KOps/s	82.7509 KOps/s	$\color{#35bf28}+1.16\%$
test_step_mdp_speed[False-False-True-True-True]	65.1770μs	28.1578μs	35.5142 KOps/s	35.5329 KOps/s	$\color{#d91a1a}-0.05\%$
test_step_mdp_speed[False-False-True-True-False]	42.9540μs	18.8066μs	53.1728 KOps/s	52.6978 KOps/s	$\color{#35bf28}+0.90\%$
test_step_mdp_speed[False-False-True-False-True]	55.3880μs	18.5251μs	53.9809 KOps/s	53.2014 KOps/s	$\color{#35bf28}+1.47\%$
test_step_mdp_speed[False-False-True-False-False]	38.7630μs	12.1372μs	82.3912 KOps/s	84.6588 KOps/s	$\color{#d91a1a}-2.68\%$
test_step_mdp_speed[False-False-False-True-True]	60.6330μs	28.7413μs	34.7932 KOps/s	34.4701 KOps/s	$\color{#35bf28}+0.94\%$
test_step_mdp_speed[False-False-False-True-False]	48.8310μs	20.0068μs	49.9829 KOps/s	50.5545 KOps/s	$\color{#d91a1a}-1.13\%$
test_step_mdp_speed[False-False-False-False-True]	49.2820μs	19.4922μs	51.3025 KOps/s	50.8835 KOps/s	$\color{#35bf28}+0.82\%$
test_step_mdp_speed[False-False-False-False-False]	37.0500μs	13.1495μs	76.0486 KOps/s	76.2810 KOps/s	$\color{#d91a1a}-0.30\%$
test_values[generalized_advantage_estimate-True-True]	48.0909ms	13.2638ms	75.3931 Ops/s	81.3994 Ops/s	$\textbf{\color{#d91a1a}-7.38\%}$
test_values[vec_generalized_advantage_estimate-True-True]	35.1900ms	26.5715ms	37.6343 Ops/s	36.8696 Ops/s	$\color{#35bf28}+2.07\%$
test_values[td0_return_estimate-False-False]	0.2614ms	0.1773ms	5.6392 KOps/s	5.7385 KOps/s	$\color{#d91a1a}-1.73\%$
test_values[td1_return_estimate-False-False]	30.7044ms	26.1318ms	38.2675 Ops/s	39.0032 Ops/s	$\color{#d91a1a}-1.89\%$
test_values[vec_td1_return_estimate-False-False]	36.6919ms	26.7539ms	37.3777 Ops/s	37.7189 Ops/s	$\color{#d91a1a}-0.90\%$
test_values[td_lambda_return_estimate-True-False]	40.0439ms	36.1230ms	27.6832 Ops/s	27.5467 Ops/s	$\color{#35bf28}+0.50\%$
test_values[vec_td_lambda_return_estimate-True-False]	36.3851ms	26.8763ms	37.2075 Ops/s	37.6300 Ops/s	$\color{#d91a1a}-1.12\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	8.6415ms	8.2013ms	121.9321 Ops/s	121.2195 Ops/s	$\color{#35bf28}+0.59\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	8.7892ms	1.9123ms	522.9352 Ops/s	526.8969 Ops/s	$\color{#d91a1a}-0.75\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	10.9482ms	0.4379ms	2.2836 KOps/s	2.3669 KOps/s	$\color{#d91a1a}-3.52\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	48.7268ms	39.9658ms	25.0214 Ops/s	26.3463 Ops/s	$\textbf{\color{#d91a1a}-5.03\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	13.5356ms	2.5228ms	396.3811 Ops/s	399.5848 Ops/s	$\color{#d91a1a}-0.80\%$
test_dqn_speed	12.2738ms	1.6055ms	622.8772 Ops/s	561.8540 Ops/s	$\textbf{\color{#35bf28}+10.86\%}$
test_ddpg_speed	67.6103ms	3.8145ms	262.1588 Ops/s	275.0497 Ops/s	$\color{#d91a1a}-4.69\%$
test_sac_speed	21.2780ms	10.2142ms	97.9027 Ops/s	97.6851 Ops/s	$\color{#35bf28}+0.22\%$
test_redq_speed	25.5381ms	19.1773ms	52.1449 Ops/s	51.7497 Ops/s	$\color{#35bf28}+0.76\%$
test_redq_deprec_speed	26.0218ms	15.2159ms	65.7208 Ops/s	64.5423 Ops/s	$\color{#35bf28}+1.83\%$
test_td3_speed	18.3340ms	10.4174ms	95.9935 Ops/s	94.8674 Ops/s	$\color{#35bf28}+1.19\%$
test_cql_speed	48.4486ms	38.4758ms	25.9904 Ops/s	25.8516 Ops/s	$\color{#35bf28}+0.54\%$
test_a2c_speed	20.2229ms	8.1818ms	122.2222 Ops/s	117.9750 Ops/s	$\color{#35bf28}+3.60\%$
test_ppo_speed	21.5412ms	8.5069ms	117.5511 Ops/s	113.7771 Ops/s	$\color{#35bf28}+3.32\%$
test_reinforce_speed	19.0525ms	7.2385ms	138.1496 Ops/s	128.6098 Ops/s	$\textbf{\color{#35bf28}+7.42\%}$
test_iql_speed	45.1209ms	34.4507ms	29.0270 Ops/s	28.2776 Ops/s	$\color{#35bf28}+2.65\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.4147ms	1.8790ms	532.1857 Ops/s	540.4561 Ops/s	$\color{#d91a1a}-1.53\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	2.7207ms	2.0120ms	497.0121 Ops/s	490.2893 Ops/s	$\color{#35bf28}+1.37\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	2.7867ms	2.0134ms	496.6601 Ops/s	485.4736 Ops/s	$\color{#35bf28}+2.30\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.5650ms	1.8718ms	534.2496 Ops/s	533.6876 Ops/s	$\color{#35bf28}+0.11\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	2.9099ms	2.0024ms	499.4112 Ops/s	497.9570 Ops/s	$\color{#35bf28}+0.29\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.0398ms	2.0099ms	497.5393 Ops/s	495.4979 Ops/s	$\color{#35bf28}+0.41\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.2389ms	1.8611ms	537.3244 Ops/s	525.2396 Ops/s	$\color{#35bf28}+2.30\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.0717ms	1.9805ms	504.9279 Ops/s	493.7774 Ops/s	$\color{#35bf28}+2.26\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	2.6174ms	1.9517ms	512.3842 Ops/s	490.3453 Ops/s	$\color{#35bf28}+4.49\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	2.0570ms	1.8597ms	537.7186 Ops/s	535.9282 Ops/s	$\color{#35bf28}+0.33\%$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	3.5763ms	2.0233ms	494.2306 Ops/s	490.3623 Ops/s	$\color{#35bf28}+0.79\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.0048ms	2.0405ms	490.0709 Ops/s	489.5554 Ops/s	$\color{#35bf28}+0.11\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	3.6900ms	2.0076ms	498.1019 Ops/s	531.5435 Ops/s	$\textbf{\color{#d91a1a}-6.29\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	4.1882ms	2.1159ms	472.6031 Ops/s	493.4956 Ops/s	$\color{#d91a1a}-4.23\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.0483ms	2.0623ms	484.9004 Ops/s	496.2138 Ops/s	$\color{#d91a1a}-2.28\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.5476ms	1.8934ms	528.1422 Ops/s	524.2930 Ops/s	$\color{#35bf28}+0.73\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.2691ms	2.0427ms	489.5521 Ops/s	494.3832 Ops/s	$\color{#d91a1a}-0.98\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	2.9574ms	2.0461ms	488.7372 Ops/s	489.4921 Ops/s	$\color{#d91a1a}-0.15\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1865s	18.6302ms	53.6763 Ops/s	56.1390 Ops/s	$\color{#d91a1a}-4.39\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1219s	16.9751ms	58.9097 Ops/s	59.8773 Ops/s	$\color{#d91a1a}-1.62\%$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	0.1150s	16.7103ms	59.8432 Ops/s	61.2194 Ops/s	$\color{#d91a1a}-2.25\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1068s	16.2132ms	61.6782 Ops/s	61.0711 Ops/s	$\color{#35bf28}+0.99\%$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1215s	16.8711ms	59.2730 Ops/s	64.9198 Ops/s	$\textbf{\color{#d91a1a}-8.70\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.1128s	16.5561ms	60.4006 Ops/s	60.7617 Ops/s	$\color{#d91a1a}-0.59\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1157s	16.6335ms	60.1198 Ops/s	60.6598 Ops/s	$\color{#d91a1a}-0.89\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1110s	16.5515ms	60.4175 Ops/s	54.1517 Ops/s	$\textbf{\color{#35bf28}+11.57\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	0.1133s	18.2868ms	54.6843 Ops/s	60.4769 Ops/s	$\textbf{\color{#d91a1a}-9.58\%}$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 92. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1229s	0.1225s	8.1616 Ops/s	8.1225 Ops/s	$\color{#35bf28}+0.48\%$
test_sync	0.1037s	0.1032s	9.6939 Ops/s	9.6660 Ops/s	$\color{#35bf28}+0.29\%$
test_async	0.2732s	0.1017s	9.8306 Ops/s	9.9471 Ops/s	$\color{#d91a1a}-1.17\%$
test_single_pixels	0.1463s	0.1456s	6.8679 Ops/s	7.6171 Ops/s	$\textbf{\color{#d91a1a}-9.84\%}$
test_sync_pixels	0.1013s	96.2979ms	10.3844 Ops/s	10.4782 Ops/s	$\color{#d91a1a}-0.89\%$
test_async_pixels	0.2454s	92.2325ms	10.8422 Ops/s	10.8848 Ops/s	$\color{#d91a1a}-0.39\%$
test_simple	0.9569s	0.8899s	1.1237 Ops/s	1.0981 Ops/s	$\color{#35bf28}+2.33\%$
test_transformed	1.1990s	1.1342s	0.8817 Ops/s	0.8981 Ops/s	$\color{#d91a1a}-1.83\%$
test_serial	2.5172s	2.4564s	0.4071 Ops/s	0.4046 Ops/s	$\color{#35bf28}+0.63\%$
test_parallel	2.6021s	2.5390s	0.3939 Ops/s	0.3955 Ops/s	$\color{#d91a1a}-0.42\%$
test_step_mdp_speed[True-True-True-True-True]	88.6010μs	34.5255μs	28.9641 KOps/s	29.2155 KOps/s	$\color{#d91a1a}-0.86\%$
test_step_mdp_speed[True-True-True-True-False]	38.7100μs	20.5722μs	48.6092 KOps/s	48.9198 KOps/s	$\color{#d91a1a}-0.64\%$
test_step_mdp_speed[True-True-True-False-True]	42.8610μs	20.4123μs	48.9900 KOps/s	49.1226 KOps/s	$\color{#d91a1a}-0.27\%$
test_step_mdp_speed[True-True-True-False-False]	55.2610μs	12.0715μs	82.8397 KOps/s	83.0228 KOps/s	$\color{#d91a1a}-0.22\%$
test_step_mdp_speed[True-True-False-True-True]	66.4610μs	36.2320μs	27.5999 KOps/s	27.4268 KOps/s	$\color{#35bf28}+0.63\%$
test_step_mdp_speed[True-True-False-True-False]	64.3910μs	22.3766μs	44.6895 KOps/s	44.9418 KOps/s	$\color{#d91a1a}-0.56\%$
test_step_mdp_speed[True-True-False-False-True]	40.8210μs	22.1047μs	45.2393 KOps/s	45.3324 KOps/s	$\color{#d91a1a}-0.21\%$
test_step_mdp_speed[True-True-False-False-False]	47.6600μs	13.9152μs	71.8636 KOps/s	72.2281 KOps/s	$\color{#d91a1a}-0.50\%$
test_step_mdp_speed[True-False-True-True-True]	67.8110μs	38.5201μs	25.9605 KOps/s	26.1468 KOps/s	$\color{#d91a1a}-0.71\%$
test_step_mdp_speed[True-False-True-True-False]	89.6920μs	24.2401μs	41.2539 KOps/s	41.8166 KOps/s	$\color{#d91a1a}-1.35\%$
test_step_mdp_speed[True-False-True-False-True]	65.6020μs	22.4708μs	44.5023 KOps/s	45.1531 KOps/s	$\color{#d91a1a}-1.44\%$
test_step_mdp_speed[True-False-True-False-False]	30.8610μs	13.9760μs	71.5512 KOps/s	71.9210 KOps/s	$\color{#d91a1a}-0.51\%$
test_step_mdp_speed[True-False-False-True-True]	80.2320μs	40.0348μs	24.9783 KOps/s	24.9112 KOps/s	$\color{#35bf28}+0.27\%$
test_step_mdp_speed[True-False-False-True-False]	42.3210μs	26.0097μs	38.4472 KOps/s	38.4210 KOps/s	$\color{#35bf28}+0.07\%$
test_step_mdp_speed[True-False-False-False-True]	59.5220μs	24.0689μs	41.5474 KOps/s	42.1221 KOps/s	$\color{#d91a1a}-1.36\%$
test_step_mdp_speed[True-False-False-False-False]	39.9210μs	15.5589μs	64.2719 KOps/s	63.4156 KOps/s	$\color{#35bf28}+1.35\%$
test_step_mdp_speed[False-True-True-True-True]	75.0310μs	38.7451μs	25.8097 KOps/s	26.1839 KOps/s	$\color{#d91a1a}-1.43\%$
test_step_mdp_speed[False-True-True-True-False]	42.3110μs	24.4976μs	40.8204 KOps/s	40.7855 KOps/s	$\color{#35bf28}+0.09\%$
test_step_mdp_speed[False-True-True-False-True]	43.7210μs	26.2853μs	38.0440 KOps/s	38.0493 KOps/s	$\color{#d91a1a}-0.01\%$
test_step_mdp_speed[False-True-True-False-False]	42.6000μs	15.6357μs	63.9564 KOps/s	61.7861 KOps/s	$\color{#35bf28}+3.51\%$
test_step_mdp_speed[False-True-False-True-True]	65.6610μs	40.0119μs	24.9926 KOps/s	25.0169 KOps/s	$\color{#d91a1a}-0.10\%$
test_step_mdp_speed[False-True-False-True-False]	51.7410μs	26.1977μs	38.1712 KOps/s	37.7471 KOps/s	$\color{#35bf28}+1.12\%$
test_step_mdp_speed[False-True-False-False-True]	44.1710μs	27.9031μs	35.8384 KOps/s	35.7203 KOps/s	$\color{#35bf28}+0.33\%$
test_step_mdp_speed[False-True-False-False-False]	36.3610μs	17.4932μs	57.1651 KOps/s	55.5811 KOps/s	$\color{#35bf28}+2.85\%$
test_step_mdp_speed[False-False-True-True-True]	66.2810μs	42.1381μs	23.7315 KOps/s	23.6544 KOps/s	$\color{#35bf28}+0.33\%$
test_step_mdp_speed[False-False-True-True-False]	46.6510μs	28.5734μs	34.9976 KOps/s	35.5227 KOps/s	$\color{#d91a1a}-1.48\%$
test_step_mdp_speed[False-False-True-False-True]	56.1510μs	27.9441μs	35.7857 KOps/s	34.9571 KOps/s	$\color{#35bf28}+2.37\%$
test_step_mdp_speed[False-False-True-False-False]	34.9100μs	17.6587μs	56.6292 KOps/s	55.5533 KOps/s	$\color{#35bf28}+1.94\%$
test_step_mdp_speed[False-False-False-True-True]	76.2020μs	43.5710μs	22.9510 KOps/s	23.0925 KOps/s	$\color{#d91a1a}-0.61\%$
test_step_mdp_speed[False-False-False-True-False]	81.7120μs	29.9717μs	33.3648 KOps/s	33.3235 KOps/s	$\color{#35bf28}+0.12\%$
test_step_mdp_speed[False-False-False-False-True]	48.2210μs	29.8513μs	33.4994 KOps/s	34.0431 KOps/s	$\color{#d91a1a}-1.60\%$
test_step_mdp_speed[False-False-False-False-False]	63.3510μs	19.2810μs	51.8645 KOps/s	51.0045 KOps/s	$\color{#35bf28}+1.69\%$
test_values[generalized_advantage_estimate-True-True]	28.0622ms	26.7452ms	37.3899 Ops/s	38.4517 Ops/s	$\color{#d91a1a}-2.76\%$
test_values[vec_generalized_advantage_estimate-True-True]	87.6615ms	3.3279ms	300.4890 Ops/s	306.3593 Ops/s	$\color{#d91a1a}-1.92\%$
test_values[td0_return_estimate-False-False]	0.1060ms	68.5784μs	14.5819 KOps/s	15.1410 KOps/s	$\color{#d91a1a}-3.69\%$
test_values[td1_return_estimate-False-False]	56.4561ms	56.0333ms	17.8465 Ops/s	17.9240 Ops/s	$\color{#d91a1a}-0.43\%$
test_values[vec_td1_return_estimate-False-False]	2.0199ms	1.7498ms	571.4978 Ops/s	575.6503 Ops/s	$\color{#d91a1a}-0.72\%$
test_values[td_lambda_return_estimate-True-False]	94.9182ms	90.7075ms	11.0244 Ops/s	11.1567 Ops/s	$\color{#d91a1a}-1.19\%$
test_values[vec_td_lambda_return_estimate-True-False]	2.0641ms	1.7488ms	571.8350 Ops/s	577.2667 Ops/s	$\color{#d91a1a}-0.94\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	27.3789ms	25.8843ms	38.6334 Ops/s	40.6865 Ops/s	$\textbf{\color{#d91a1a}-5.05\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.9123ms	0.7422ms	1.3473 KOps/s	1.3619 KOps/s	$\color{#d91a1a}-1.07\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7616ms	0.6966ms	1.4355 KOps/s	1.4546 KOps/s	$\color{#d91a1a}-1.31\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.5531ms	1.4952ms	668.8137 Ops/s	674.7725 Ops/s	$\color{#d91a1a}-0.88\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	0.9739ms	0.7224ms	1.3844 KOps/s	1.3960 KOps/s	$\color{#d91a1a}-0.83\%$
test_dqn_speed	7.7071ms	1.4727ms	679.0136 Ops/s	679.2806 Ops/s	$\color{#d91a1a}-0.04\%$
test_ddpg_speed	4.6853ms	3.2913ms	303.8291 Ops/s	299.7574 Ops/s	$\color{#35bf28}+1.36\%$
test_sac_speed	10.1820ms	9.2499ms	108.1090 Ops/s	106.6471 Ops/s	$\color{#35bf28}+1.37\%$
test_redq_speed	16.9848ms	16.6764ms	59.9651 Ops/s	59.8562 Ops/s	$\color{#35bf28}+0.18\%$
test_redq_deprec_speed	14.1995ms	12.9179ms	77.4118 Ops/s	75.7255 Ops/s	$\color{#35bf28}+2.23\%$
test_td3_speed	18.2947ms	9.4919ms	105.3528 Ops/s	103.8751 Ops/s	$\color{#35bf28}+1.42\%$
test_cql_speed	32.8717ms	31.3172ms	31.9313 Ops/s	31.5993 Ops/s	$\color{#35bf28}+1.05\%$
test_a2c_speed	0.1069s	7.8305ms	127.7053 Ops/s	137.3386 Ops/s	$\textbf{\color{#d91a1a}-7.01\%}$
test_ppo_speed	8.6251ms	7.4494ms	134.2392 Ops/s	131.5336 Ops/s	$\color{#35bf28}+2.06\%$
test_reinforce_speed	7.5550ms	6.1236ms	163.3031 Ops/s	159.0365 Ops/s	$\color{#35bf28}+2.68\%$
test_iql_speed	28.6794ms	27.0729ms	36.9373 Ops/s	36.4727 Ops/s	$\color{#35bf28}+1.27\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	3.3072ms	2.5185ms	397.0643 Ops/s	400.6255 Ops/s	$\color{#d91a1a}-0.89\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	3.9935ms	2.6923ms	371.4310 Ops/s	336.5624 Ops/s	$\textbf{\color{#35bf28}+10.36\%}$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	3.9098ms	2.7047ms	369.7207 Ops/s	373.1580 Ops/s	$\color{#d91a1a}-0.92\%$
test_sample_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	2.7411ms	2.5171ms	397.2899 Ops/s	397.0239 Ops/s	$\color{#35bf28}+0.07\%$
test_sample_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	4.0892ms	2.7162ms	368.1659 Ops/s	374.8519 Ops/s	$\color{#d91a1a}-1.78\%$
test_sample_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	4.0776ms	2.7096ms	369.0569 Ops/s	374.5551 Ops/s	$\color{#d91a1a}-1.47\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	2.7223ms	2.4919ms	401.3043 Ops/s	399.0136 Ops/s	$\color{#35bf28}+0.57\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	4.4033ms	2.7112ms	368.8455 Ops/s	377.5153 Ops/s	$\color{#d91a1a}-2.30\%$
test_sample_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	4.1033ms	2.7064ms	369.4980 Ops/s	373.1584 Ops/s	$\color{#d91a1a}-0.98\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	0.1920s	2.9916ms	334.2647 Ops/s	403.0507 Ops/s	$\textbf{\color{#d91a1a}-17.07\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	3.5808ms	2.7004ms	370.3155 Ops/s	373.2667 Ops/s	$\color{#d91a1a}-0.79\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	4.3473ms	2.7084ms	369.2188 Ops/s	375.4305 Ops/s	$\color{#d91a1a}-1.65\%$
test_iterate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	0.1927s	3.0340ms	329.6025 Ops/s	400.0419 Ops/s	$\textbf{\color{#d91a1a}-17.61\%}$
test_iterate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	3.9906ms	2.7110ms	368.8717 Ops/s	376.1296 Ops/s	$\color{#d91a1a}-1.93\%$
test_iterate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	3.7066ms	2.6915ms	371.5362 Ops/s	373.7121 Ops/s	$\color{#d91a1a}-0.58\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	3.0588ms	2.5229ms	396.3668 Ops/s	404.6670 Ops/s	$\color{#d91a1a}-2.05\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	3.9675ms	2.7088ms	369.1624 Ops/s	372.5172 Ops/s	$\color{#d91a1a}-0.90\%$
test_iterate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	3.8443ms	2.6921ms	371.4565 Ops/s	373.2796 Ops/s	$\color{#d91a1a}-0.49\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.2378s	17.6168ms	56.7640 Ops/s	51.7775 Ops/s	$\textbf{\color{#35bf28}+9.63\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1257s	17.5444ms	56.9982 Ops/s	65.8776 Ops/s	$\textbf{\color{#d91a1a}-13.48\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	0.1272s	17.4925ms	57.1674 Ops/s	57.2786 Ops/s	$\color{#d91a1a}-0.19\%$
test_populate_rb[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1256s	17.5134ms	57.0992 Ops/s	65.6214 Ops/s	$\textbf{\color{#d91a1a}-12.99\%}$
test_populate_rb[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	0.1254s	15.2503ms	65.5724 Ops/s	57.0273 Ops/s	$\textbf{\color{#35bf28}+14.98\%}$
test_populate_rb[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.1272s	17.4995ms	57.1446 Ops/s	65.8413 Ops/s	$\textbf{\color{#d91a1a}-13.21\%}$
test_populate_rb[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1266s	17.5221ms	57.0709 Ops/s	57.4645 Ops/s	$\color{#d91a1a}-0.69\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1256s	17.5167ms	57.0883 Ops/s	56.8891 Ops/s	$\color{#35bf28}+0.35\%$
test_populate_rb[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	0.1261s	15.2643ms	65.5122 Ops/s	57.1358 Ops/s	$\textbf{\color{#35bf28}+14.66\%}$