[CI] Fix broken workflows

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2428

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 5 Unrelated Failures

As of commit a6cffad with merge base 0ad8e59 ():

NEW FAILURES - The following jobs have failed:

• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 6ee72143b442e1ad2d4d97525026e4d0514f129e3c6593df3e76676021d7d717 /exec failed with exit code 134
• Libs Tests on Linux / unittests-minari (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 7311d336970fd143a49167a316c583628c60917f56578b587c1a1f3c48247b28 /exec failed with exit code 2
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh)
  test/test_exploration.py::TestConsistentDropout::test_consistent_dropout[device0-True-0.5]

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Build Windows Wheels / pytorch/rl (pytorch/rl, .github/scripts/td_script.sh, .github/scripts/version_script.bat, python ... / upload / wheel-py3_9-cpu (gh) (trunk failure)
• Build Windows Wheels / pytorch/rl (pytorch/rl, .github/scripts/td_script.sh, .github/scripts/version_script.bat, python ... / upload / wheel-py3_9-cuda11_8 (gh) (trunk failure)
• Build Windows Wheels / pytorch/rl (pytorch/rl, .github/scripts/td_script.sh, .github/scripts/version_script.bat, python ... / upload / wheel-py3_9-cuda12_1 (gh) (trunk failure)
• Build Windows Wheels / pytorch/rl (pytorch/rl, .github/scripts/td_script.sh, .github/scripts/version_script.bat, python ... / upload / wheel-py3_9-cuda12_4 (gh) (trunk failure)
• Libs Tests on Linux / unittests-robohive (3.9, 12.1) / linux-job (gh) (trunk failure)
  test/test_libs.py::TestRoboHive::test_robohive[franka_slide_random-v3-True-True]

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}1$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	60.4654ms	59.8594ms	16.7058 Ops/s	16.4854 Ops/s	$\color{#35bf28}+1.34\%$
test_sync	37.5971ms	32.5042ms	30.7653 Ops/s	30.0579 Ops/s	$\color{#35bf28}+2.35\%$
test_async	98.5978ms	31.8034ms	31.4432 Ops/s	32.4098 Ops/s	$\color{#d91a1a}-2.98\%$
test_simple	0.5108s	0.4259s	2.3480 Ops/s	2.4415 Ops/s	$\color{#d91a1a}-3.83\%$
test_transformed	0.6744s	0.5980s	1.6722 Ops/s	1.7400 Ops/s	$\color{#d91a1a}-3.90\%$
test_serial	1.3590s	1.2874s	0.7768 Ops/s	0.7674 Ops/s	$\color{#35bf28}+1.22\%$
test_parallel	1.2081s	1.1335s	0.8822 Ops/s	0.8683 Ops/s	$\color{#35bf28}+1.60\%$
test_step_mdp_speed[True-True-True-True-True]	0.1934ms	27.2030μs	36.7606 KOps/s	36.7767 KOps/s	$\color{#d91a1a}-0.04\%$
test_step_mdp_speed[True-True-True-True-False]	53.1500μs	16.0016μs	62.4939 KOps/s	61.6171 KOps/s	$\color{#35bf28}+1.42\%$
test_step_mdp_speed[True-True-True-False-True]	58.9900μs	15.7319μs	63.5651 KOps/s	64.3431 KOps/s	$\color{#d91a1a}-1.21\%$
test_step_mdp_speed[True-True-True-False-False]	37.5000μs	9.1865μs	108.8551 KOps/s	108.2207 KOps/s	$\color{#35bf28}+0.59\%$
test_step_mdp_speed[True-True-False-True-True]	68.2780μs	29.0665μs	34.4038 KOps/s	34.3914 KOps/s	$\color{#35bf28}+0.04\%$
test_step_mdp_speed[True-True-False-True-False]	45.5350μs	17.4806μs	57.2062 KOps/s	55.7109 KOps/s	$\color{#35bf28}+2.68\%$
test_step_mdp_speed[True-True-False-False-True]	70.1520μs	17.2535μs	57.9593 KOps/s	58.2119 KOps/s	$\color{#d91a1a}-0.43\%$
test_step_mdp_speed[True-True-False-False-False]	43.8620μs	10.8901μs	91.8261 KOps/s	91.6102 KOps/s	$\color{#35bf28}+0.24\%$
test_step_mdp_speed[True-False-True-True-True]	80.0500μs	30.8865μs	32.3766 KOps/s	32.7369 KOps/s	$\color{#d91a1a}-1.10\%$
test_step_mdp_speed[True-False-True-True-False]	56.3260μs	19.4671μs	51.3688 KOps/s	51.6139 KOps/s	$\color{#d91a1a}-0.47\%$
test_step_mdp_speed[True-False-True-False-True]	47.6590μs	17.4722μs	57.2339 KOps/s	58.1465 KOps/s	$\color{#d91a1a}-1.57\%$
test_step_mdp_speed[True-False-True-False-False]	39.4130μs	10.9794μs	91.0793 KOps/s	91.0734 KOps/s	$+0.01\%$
test_step_mdp_speed[True-False-False-True-True]	76.8850μs	32.2838μs	30.9753 KOps/s	31.0940 KOps/s	$\color{#d91a1a}-0.38\%$
test_step_mdp_speed[True-False-False-True-False]	61.4660μs	21.1718μs	47.2325 KOps/s	46.8588 KOps/s	$\color{#35bf28}+0.80\%$
test_step_mdp_speed[True-False-False-False-True]	60.6740μs	18.8440μs	53.0672 KOps/s	53.3675 KOps/s	$\color{#d91a1a}-0.56\%$
test_step_mdp_speed[True-False-False-False-False]	44.3320μs	12.4673μs	80.2100 KOps/s	79.9309 KOps/s	$\color{#35bf28}+0.35\%$
test_step_mdp_speed[False-True-True-True-True]	67.3860μs	31.0968μs	32.1576 KOps/s	32.1996 KOps/s	$\color{#d91a1a}-0.13\%$
test_step_mdp_speed[False-True-True-True-False]	83.0350μs	19.0966μs	52.3654 KOps/s	50.9374 KOps/s	$\color{#35bf28}+2.80\%$
test_step_mdp_speed[False-True-True-False-True]	62.0260μs	19.8570μs	50.3602 KOps/s	50.0733 KOps/s	$\color{#35bf28}+0.57\%$
test_step_mdp_speed[False-True-True-False-False]	42.5500μs	12.0783μs	82.7928 KOps/s	81.1507 KOps/s	$\color{#35bf28}+2.02\%$
test_step_mdp_speed[False-True-False-True-True]	75.9720μs	32.6220μs	30.6542 KOps/s	30.8614 KOps/s	$\color{#d91a1a}-0.67\%$
test_step_mdp_speed[False-True-False-True-False]	51.0460μs	20.8268μs	48.0150 KOps/s	47.0239 KOps/s	$\color{#35bf28}+2.11\%$
test_step_mdp_speed[False-True-False-False-True]	3.0390ms	21.4893μs	46.5347 KOps/s	46.6258 KOps/s	$\color{#d91a1a}-0.20\%$
test_step_mdp_speed[False-True-False-False-False]	39.0040μs	13.7250μs	72.8599 KOps/s	71.8298 KOps/s	$\color{#35bf28}+1.43\%$
test_step_mdp_speed[False-False-True-True-True]	98.4210μs	33.0724μs	30.2367 KOps/s	29.3414 KOps/s	$\color{#35bf28}+3.05\%$
test_step_mdp_speed[False-False-True-True-False]	56.3960μs	22.4852μs	44.4737 KOps/s	43.7570 KOps/s	$\color{#35bf28}+1.64\%$
test_step_mdp_speed[False-False-True-False-True]	84.4680μs	21.6325μs	46.2268 KOps/s	45.8129 KOps/s	$\color{#35bf28}+0.90\%$
test_step_mdp_speed[False-False-True-False-False]	49.5530μs	13.5734μs	73.6736 KOps/s	71.8883 KOps/s	$\color{#35bf28}+2.48\%$
test_step_mdp_speed[False-False-False-True-True]	87.3940μs	35.2695μs	28.3531 KOps/s	28.4256 KOps/s	$\color{#d91a1a}-0.26\%$
test_step_mdp_speed[False-False-False-True-False]	50.3840μs	24.0443μs	41.5899 KOps/s	41.1236 KOps/s	$\color{#35bf28}+1.13\%$
test_step_mdp_speed[False-False-False-False-True]	55.5530μs	22.6186μs	44.2114 KOps/s	44.9048 KOps/s	$\color{#d91a1a}-1.54\%$
test_step_mdp_speed[False-False-False-False-False]	44.8140μs	15.1427μs	66.0383 KOps/s	65.7684 KOps/s	$\color{#35bf28}+0.41\%$
test_values[generalized_advantage_estimate-True-True]	9.9083ms	9.3000ms	107.5266 Ops/s	104.4624 Ops/s	$\color{#35bf28}+2.93\%$
test_values[vec_generalized_advantage_estimate-True-True]	38.8202ms	36.3867ms	27.4826 Ops/s	29.7766 Ops/s	$\textbf{\color{#d91a1a}-7.70\%}$
test_values[td0_return_estimate-False-False]	0.2349ms	0.1710ms	5.8480 KOps/s	6.0132 KOps/s	$\color{#d91a1a}-2.75\%$
test_values[td1_return_estimate-False-False]	26.9691ms	23.7355ms	42.1309 Ops/s	42.8850 Ops/s	$\color{#d91a1a}-1.76\%$
test_values[vec_td1_return_estimate-False-False]	38.3917ms	36.7477ms	27.2126 Ops/s	29.0749 Ops/s	$\textbf{\color{#d91a1a}-6.41\%}$
test_values[td_lambda_return_estimate-True-False]	35.6769ms	34.4658ms	29.0143 Ops/s	29.8493 Ops/s	$\color{#d91a1a}-2.80\%$
test_values[vec_td_lambda_return_estimate-True-False]	39.0680ms	36.6850ms	27.2591 Ops/s	29.1073 Ops/s	$\textbf{\color{#d91a1a}-6.35\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	10.6270ms	8.2294ms	121.5158 Ops/s	120.3586 Ops/s	$\color{#35bf28}+0.96\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	2.3645ms	1.9922ms	501.9620 Ops/s	523.4796 Ops/s	$\color{#d91a1a}-4.11\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.4962ms	0.3556ms	2.8124 KOps/s	2.7616 KOps/s	$\color{#35bf28}+1.84\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	54.6523ms	46.0519ms	21.7146 Ops/s	22.4731 Ops/s	$\color{#d91a1a}-3.38\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	3.9677ms	3.0518ms	327.6769 Ops/s	331.3373 Ops/s	$\color{#d91a1a}-1.10\%$
test_dqn_speed	6.3569ms	1.3600ms	735.2871 Ops/s	717.0461 Ops/s	$\color{#35bf28}+2.54\%$
test_ddpg_speed	3.5553ms	2.8107ms	355.7869 Ops/s	359.2355 Ops/s	$\color{#d91a1a}-0.96\%$
test_sac_speed	9.1988ms	8.2369ms	121.4043 Ops/s	122.6673 Ops/s	$\color{#d91a1a}-1.03\%$
test_redq_speed	13.6993ms	13.0381ms	76.6982 Ops/s	76.9805 Ops/s	$\color{#d91a1a}-0.37\%$
test_redq_deprec_speed	14.2461ms	12.9166ms	77.4195 Ops/s	77.7145 Ops/s	$\color{#d91a1a}-0.38\%$
test_td3_speed	9.1557ms	8.2693ms	120.9287 Ops/s	120.7367 Ops/s	$\color{#35bf28}+0.16\%$
test_cql_speed	37.2782ms	36.2720ms	27.5695 Ops/s	28.1995 Ops/s	$\color{#d91a1a}-2.23\%$
test_a2c_speed	8.7712ms	7.6501ms	130.7174 Ops/s	136.6253 Ops/s	$\color{#d91a1a}-4.32\%$
test_ppo_speed	8.5653ms	7.8746ms	126.9900 Ops/s	131.4899 Ops/s	$\color{#d91a1a}-3.42\%$
test_reinforce_speed	8.2195ms	6.8386ms	146.2293 Ops/s	150.9656 Ops/s	$\color{#d91a1a}-3.14\%$
test_iql_speed	34.4801ms	32.8035ms	30.4845 Ops/s	30.9906 Ops/s	$\color{#d91a1a}-1.63\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	7.0440ms	4.8866ms	204.6415 Ops/s	208.1934 Ops/s	$\color{#d91a1a}-1.71\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.0202ms	0.4784ms	2.0904 KOps/s	2.1164 KOps/s	$\color{#d91a1a}-1.23\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.8058ms	0.4515ms	2.2147 KOps/s	2.2274 KOps/s	$\color{#d91a1a}-0.57\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	5.3004ms	4.8760ms	205.0882 Ops/s	212.8698 Ops/s	$\color{#d91a1a}-3.66\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.8761ms	0.4714ms	2.1213 KOps/s	2.1461 KOps/s	$\color{#d91a1a}-1.15\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.6519ms	0.4438ms	2.2533 KOps/s	2.2618 KOps/s	$\color{#d91a1a}-0.37\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	2.4007ms	1.5959ms	626.6233 Ops/s	623.2848 Ops/s	$\color{#35bf28}+0.54\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	2.3101ms	1.5042ms	664.8116 Ops/s	661.5259 Ops/s	$\color{#35bf28}+0.50\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	5.6064ms	4.9842ms	200.6333 Ops/s	207.6110 Ops/s	$\color{#d91a1a}-3.36\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.9018ms	0.6130ms	1.6313 KOps/s	1.6476 KOps/s	$\color{#d91a1a}-0.99\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.9770ms	0.5955ms	1.6792 KOps/s	1.7140 KOps/s	$\color{#d91a1a}-2.03\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	5.4136ms	5.1387ms	194.6009 Ops/s	209.6348 Ops/s	$\textbf{\color{#d91a1a}-7.17\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.8710ms	0.4924ms	2.0308 KOps/s	2.0959 KOps/s	$\color{#d91a1a}-3.11\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.9594ms	0.4759ms	2.1011 KOps/s	2.2353 KOps/s	$\textbf{\color{#d91a1a}-6.00\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	8.0270ms	5.1373ms	194.6556 Ops/s	212.5461 Ops/s	$\textbf{\color{#d91a1a}-8.42\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.4373ms	0.4808ms	2.0798 KOps/s	2.1455 KOps/s	$\color{#d91a1a}-3.06\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.9007ms	0.4683ms	2.1353 KOps/s	2.2073 KOps/s	$\color{#d91a1a}-3.26\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	5.6391ms	5.1638ms	193.6572 Ops/s	202.1464 Ops/s	$\color{#d91a1a}-4.20\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.6055ms	0.6271ms	1.5946 KOps/s	1.6356 KOps/s	$\color{#d91a1a}-2.51\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8235ms	0.5831ms	1.7150 KOps/s	1.6913 KOps/s	$\color{#35bf28}+1.40\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1448s	6.9073ms	144.7742 Ops/s	149.1575 Ops/s	$\color{#d91a1a}-2.94\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	0.1291s	15.5801ms	64.1843 Ops/s	76.8498 Ops/s	$\textbf{\color{#d91a1a}-16.48\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	2.0208ms	1.2607ms	793.2058 Ops/s	803.6334 Ops/s	$\color{#d91a1a}-1.30\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1246s	6.5607ms	152.4226 Ops/s	159.4871 Ops/s	$\color{#d91a1a}-4.43\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	17.2934ms	13.1922ms	75.8022 Ops/s	77.6349 Ops/s	$\color{#d91a1a}-2.36\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	6.7942ms	1.3551ms	737.9762 Ops/s	760.4996 Ops/s	$\color{#d91a1a}-2.96\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1225s	6.5179ms	153.4236 Ops/s	115.5415 Ops/s	$\textbf{\color{#35bf28}+32.79\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	18.3825ms	13.4805ms	74.1813 Ops/s	76.2945 Ops/s	$\color{#d91a1a}-2.77\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	6.6650ms	1.5029ms	665.3881 Ops/s	722.6644 Ops/s	$\textbf{\color{#d91a1a}-7.93\%}$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}5$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_single	0.1012s	0.1007s	9.9335 Ops/s	9.2041 Ops/s	$\textbf{\color{#35bf28}+7.93\%}$
test_sync	87.9064ms	86.9755ms	11.4975 Ops/s	11.4042 Ops/s	$\color{#35bf28}+0.82\%$
test_async	0.1607s	81.5809ms	12.2578 Ops/s	12.0848 Ops/s	$\color{#35bf28}+1.43\%$
test_single_pixels	0.1064s	0.1063s	9.4094 Ops/s	9.2690 Ops/s	$\color{#35bf28}+1.51\%$
test_sync_pixels	72.1133ms	69.1902ms	14.4529 Ops/s	14.0124 Ops/s	$\color{#35bf28}+3.14\%$
test_async_pixels	0.1336s	67.5384ms	14.8064 Ops/s	15.0202 Ops/s	$\color{#d91a1a}-1.42\%$
test_simple	0.7044s	0.7028s	1.4229 Ops/s	1.3842 Ops/s	$\color{#35bf28}+2.80\%$
test_transformed	0.9211s	0.9192s	1.0879 Ops/s	1.0561 Ops/s	$\color{#35bf28}+3.01\%$
test_serial	2.0756s	1.9991s	0.5002 Ops/s	0.4929 Ops/s	$\color{#35bf28}+1.49\%$
test_parallel	1.8454s	1.8209s	0.5492 Ops/s	0.5468 Ops/s	$\color{#35bf28}+0.43\%$
test_step_mdp_speed[True-True-True-True-True]	0.2016ms	34.8675μs	28.6800 KOps/s	28.2824 KOps/s	$\color{#35bf28}+1.41\%$
test_step_mdp_speed[True-True-True-True-False]	0.4043ms	19.7708μs	50.5796 KOps/s	49.1219 KOps/s	$\color{#35bf28}+2.97\%$
test_step_mdp_speed[True-True-True-False-True]	0.4103ms	19.6239μs	50.9583 KOps/s	51.5613 KOps/s	$\color{#d91a1a}-1.17\%$
test_step_mdp_speed[True-True-True-False-False]	92.1320μs	11.2724μs	88.7124 KOps/s	88.1909 KOps/s	$\color{#35bf28}+0.59\%$
test_step_mdp_speed[True-True-False-True-True]	0.4270ms	37.3110μs	26.8017 KOps/s	26.6618 KOps/s	$\color{#35bf28}+0.52\%$
test_step_mdp_speed[True-True-False-True-False]	0.4067ms	21.8165μs	45.8368 KOps/s	44.9998 KOps/s	$\color{#35bf28}+1.86\%$
test_step_mdp_speed[True-True-False-False-True]	99.9620μs	21.4768μs	46.5618 KOps/s	46.3557 KOps/s	$\color{#35bf28}+0.44\%$
test_step_mdp_speed[True-True-False-False-False]	0.4020ms	13.2522μs	75.4593 KOps/s	74.9596 KOps/s	$\color{#35bf28}+0.67\%$
test_step_mdp_speed[True-False-True-True-True]	0.4244ms	40.0087μs	24.9946 KOps/s	25.4805 KOps/s	$\color{#d91a1a}-1.91\%$
test_step_mdp_speed[True-False-True-True-False]	0.4036ms	23.9078μs	41.8273 KOps/s	41.4832 KOps/s	$\color{#35bf28}+0.83\%$
test_step_mdp_speed[True-False-True-False-True]	0.1008ms	21.4124μs	46.7019 KOps/s	45.8465 KOps/s	$\color{#35bf28}+1.87\%$
test_step_mdp_speed[True-False-True-False-False]	0.1554ms	13.0796μs	76.4552 KOps/s	74.6809 KOps/s	$\color{#35bf28}+2.38\%$
test_step_mdp_speed[True-False-False-True-True]	0.4242ms	41.0601μs	24.3545 KOps/s	24.3048 KOps/s	$\color{#35bf28}+0.20\%$
test_step_mdp_speed[True-False-False-True-False]	0.1088ms	25.3711μs	39.4149 KOps/s	38.4444 KOps/s	$\color{#35bf28}+2.52\%$
test_step_mdp_speed[True-False-False-False-True]	0.4171ms	22.7654μs	43.9263 KOps/s	41.8221 KOps/s	$\textbf{\color{#35bf28}+5.03\%}$
test_step_mdp_speed[True-False-False-False-False]	0.3935ms	14.8323μs	67.4205 KOps/s	65.6111 KOps/s	$\color{#35bf28}+2.76\%$
test_step_mdp_speed[False-True-True-True-True]	0.4237ms	38.8504μs	25.7397 KOps/s	25.1606 KOps/s	$\color{#35bf28}+2.30\%$
test_step_mdp_speed[False-True-True-True-False]	0.2272ms	23.7518μs	42.1020 KOps/s	41.2274 KOps/s	$\color{#35bf28}+2.12\%$
test_step_mdp_speed[False-True-True-False-True]	0.4166ms	24.5035μs	40.8104 KOps/s	39.6419 KOps/s	$\color{#35bf28}+2.95\%$
test_step_mdp_speed[False-True-True-False-False]	0.4133ms	14.5716μs	68.6265 KOps/s	65.7694 KOps/s	$\color{#35bf28}+4.34\%$
test_step_mdp_speed[False-True-False-True-True]	0.1207ms	40.6411μs	24.6056 KOps/s	23.8575 KOps/s	$\color{#35bf28}+3.14\%$
test_step_mdp_speed[False-True-False-True-False]	0.4076ms	25.1952μs	39.6902 KOps/s	38.4715 KOps/s	$\color{#35bf28}+3.17\%$
test_step_mdp_speed[False-True-False-False-True]	3.7202ms	26.4826μs	37.7606 KOps/s	36.5629 KOps/s	$\color{#35bf28}+3.28\%$
test_step_mdp_speed[False-True-False-False-False]	0.4172ms	16.2807μs	61.4224 KOps/s	58.9910 KOps/s	$\color{#35bf28}+4.12\%$
test_step_mdp_speed[False-False-True-True-True]	0.1905ms	42.2605μs	23.6628 KOps/s	23.0763 KOps/s	$\color{#35bf28}+2.54\%$
test_step_mdp_speed[False-False-True-True-False]	0.4150ms	27.5551μs	36.2909 KOps/s	36.1863 KOps/s	$\color{#35bf28}+0.29\%$
test_step_mdp_speed[False-False-True-False-True]	0.4157ms	26.4069μs	37.8689 KOps/s	37.0413 KOps/s	$\color{#35bf28}+2.23\%$
test_step_mdp_speed[False-False-True-False-False]	93.0720μs	16.4477μs	60.7989 KOps/s	58.9703 KOps/s	$\color{#35bf28}+3.10\%$
test_step_mdp_speed[False-False-False-True-True]	0.4276ms	44.0234μs	22.7152 KOps/s	22.3801 KOps/s	$\color{#35bf28}+1.50\%$
test_step_mdp_speed[False-False-False-True-False]	0.4112ms	29.4178μs	33.9930 KOps/s	33.3225 KOps/s	$\color{#35bf28}+2.01\%$
test_step_mdp_speed[False-False-False-False-True]	0.4081ms	27.6913μs	36.1124 KOps/s	34.8766 KOps/s	$\color{#35bf28}+3.54\%$
test_step_mdp_speed[False-False-False-False-False]	86.4510μs	18.1898μs	54.9758 KOps/s	53.4444 KOps/s	$\color{#35bf28}+2.87\%$
test_values[generalized_advantage_estimate-True-True]	25.1013ms	24.5641ms	40.7098 Ops/s	40.7388 Ops/s	$\color{#d91a1a}-0.07\%$
test_values[vec_generalized_advantage_estimate-True-True]	0.1065s	3.0200ms	331.1294 Ops/s	325.2354 Ops/s	$\color{#35bf28}+1.81\%$
test_values[td0_return_estimate-False-False]	94.2220μs	66.2206μs	15.1010 KOps/s	15.3794 KOps/s	$\color{#d91a1a}-1.81\%$
test_values[td1_return_estimate-False-False]	55.6319ms	55.1788ms	18.1229 Ops/s	18.3534 Ops/s	$\color{#d91a1a}-1.26\%$
test_values[vec_td1_return_estimate-False-False]	1.2521ms	1.0732ms	931.8255 Ops/s	938.5254 Ops/s	$\color{#d91a1a}-0.71\%$
test_values[td_lambda_return_estimate-True-False]	88.2602ms	87.6724ms	11.4061 Ops/s	11.5538 Ops/s	$\color{#d91a1a}-1.28\%$
test_values[vec_td_lambda_return_estimate-True-False]	1.1966ms	1.0779ms	927.6998 Ops/s	941.8413 Ops/s	$\color{#d91a1a}-1.50\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	24.5426ms	24.2530ms	41.2321 Ops/s	41.5015 Ops/s	$\color{#d91a1a}-0.65\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	0.9805ms	0.7292ms	1.3713 KOps/s	1.4106 KOps/s	$\color{#d91a1a}-2.78\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.7503ms	0.6648ms	1.5042 KOps/s	1.5322 KOps/s	$\color{#d91a1a}-1.83\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	1.5240ms	1.4647ms	682.7273 Ops/s	689.3829 Ops/s	$\color{#d91a1a}-0.97\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	1.0763ms	0.6783ms	1.4743 KOps/s	1.4994 KOps/s	$\color{#d91a1a}-1.67\%$
test_dqn_speed	7.1141ms	1.2794ms	781.6163 Ops/s	786.1924 Ops/s	$\color{#d91a1a}-0.58\%$
test_ddpg_speed	2.7665ms	2.6018ms	384.3467 Ops/s	386.1627 Ops/s	$\color{#d91a1a}-0.47\%$
test_sac_speed	7.7316ms	7.4867ms	133.5705 Ops/s	133.1366 Ops/s	$\color{#35bf28}+0.33\%$
test_redq_speed	0.1079s	10.8391ms	92.2582 Ops/s	101.6059 Ops/s	$\textbf{\color{#d91a1a}-9.20\%}$
test_redq_deprec_speed	10.9023ms	10.4230ms	95.9415 Ops/s	97.0903 Ops/s	$\color{#d91a1a}-1.18\%$
test_td3_speed	7.9725ms	7.5478ms	132.4894 Ops/s	133.6518 Ops/s	$\color{#d91a1a}-0.87\%$
test_cql_speed	27.0049ms	24.5726ms	40.6957 Ops/s	39.6532 Ops/s	$\color{#35bf28}+2.63\%$
test_a2c_speed	5.7524ms	5.3073ms	188.4182 Ops/s	183.2494 Ops/s	$\color{#35bf28}+2.82\%$
test_ppo_speed	6.0333ms	5.5570ms	179.9516 Ops/s	174.7937 Ops/s	$\color{#35bf28}+2.95\%$
test_reinforce_speed	4.8211ms	4.4199ms	226.2508 Ops/s	225.0085 Ops/s	$\color{#35bf28}+0.55\%$
test_iql_speed	19.4411ms	18.8432ms	53.0695 Ops/s	53.2194 Ops/s	$\color{#d91a1a}-0.28\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.1419ms	5.9798ms	167.2295 Ops/s	162.0145 Ops/s	$\color{#35bf28}+3.22\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.6359ms	0.3286ms	3.0435 KOps/s	4.3624 KOps/s	$\textbf{\color{#d91a1a}-30.23\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6118ms	0.3212ms	3.1131 KOps/s	4.8510 KOps/s	$\textbf{\color{#d91a1a}-35.83\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.2741ms	5.9812ms	167.1894 Ops/s	166.4121 Ops/s	$\color{#35bf28}+0.47\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.6381ms	0.2274ms	4.3978 KOps/s	4.4158 KOps/s	$\color{#d91a1a}-0.41\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.3667ms	0.2056ms	4.8645 KOps/s	4.8898 KOps/s	$\color{#d91a1a}-0.52\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.3196ms	1.1875ms	842.0725 Ops/s	833.5751 Ops/s	$\color{#35bf28}+1.02\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.2550ms	1.0992ms	909.7757 Ops/s	890.9629 Ops/s	$\color{#35bf28}+2.11\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.3383ms	6.1228ms	163.3243 Ops/s	158.8515 Ops/s	$\color{#35bf28}+2.82\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.7514ms	0.3664ms	2.7295 KOps/s	2.6783 KOps/s	$\color{#35bf28}+1.91\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.5090ms	0.3452ms	2.8971 KOps/s	2.2505 KOps/s	$\textbf{\color{#35bf28}+28.73\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.2239ms	6.0349ms	165.7023 Ops/s	165.3089 Ops/s	$\color{#35bf28}+0.24\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	1.6382ms	0.2299ms	4.3492 KOps/s	4.2670 KOps/s	$\color{#35bf28}+1.93\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5016ms	0.2079ms	4.8091 KOps/s	4.7588 KOps/s	$\color{#35bf28}+1.06\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.2306ms	5.9580ms	167.8407 Ops/s	167.2112 Ops/s	$\color{#35bf28}+0.38\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.4829ms	0.2313ms	4.3229 KOps/s	4.3645 KOps/s	$\color{#d91a1a}-0.95\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.3751ms	0.2059ms	4.8566 KOps/s	4.8592 KOps/s	$\color{#d91a1a}-0.05\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.3688ms	6.1571ms	162.4133 Ops/s	161.0251 Ops/s	$\color{#35bf28}+0.86\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.7249ms	0.3722ms	2.6865 KOps/s	2.6665 KOps/s	$\color{#35bf28}+0.75\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.4749ms	0.3493ms	2.8626 KOps/s	2.7911 KOps/s	$\color{#35bf28}+2.56\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.1496s	7.9497ms	125.7914 Ops/s	123.4827 Ops/s	$\color{#35bf28}+1.87\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	20.7671ms	15.1428ms	66.0378 Ops/s	64.2191 Ops/s	$\color{#35bf28}+2.83\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	8.7252ms	1.1068ms	903.5207 Ops/s	1.0149 KOps/s	$\textbf{\color{#d91a1a}-10.98\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.1305s	7.6203ms	131.2281 Ops/s	129.4039 Ops/s	$\color{#35bf28}+1.41\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	20.2172ms	15.1089ms	66.1862 Ops/s	55.3560 Ops/s	$\textbf{\color{#35bf28}+19.56\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	2.0016ms	0.9477ms	1.0552 KOps/s	1.0309 KOps/s	$\color{#35bf28}+2.36\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.1325s	7.7842ms	128.4645 Ops/s	126.2553 Ops/s	$\color{#35bf28}+1.75\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	0.1411s	17.8486ms	56.0267 Ops/s	63.9712 Ops/s	$\textbf{\color{#d91a1a}-12.42\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	2.0562ms	1.0813ms	924.7936 Ops/s	878.0629 Ops/s	$\textbf{\color{#35bf28}+5.32\%}$