[Feature] PyTrees in replay buffers #190

Job	Run time
unittests-pettingzoo / linux-job	9m 26s
unittests-atari-dqn (3.9, 12.1) / linux-job	12m 42s
unittests-brax (3.9, 12.1) / linux-job	9m 17s
unittests-d4rl (3.9, 12.1) / linux-job	9m 28s
unittests-envpool (3.9, 12.1) / linux-job	9m 26s
unittests-gendgrl (3.9, 12.1) / linux-job	6m 39s
unittests-gym (3.9, 12.1) / linux-job	17m 10s
unittests-jumanji (3.9, 12.1) / linux-job	8m 29s
unittests-minari (3.9, 12.1) / linux-job	15m 11s
unittests-robohive (3.9, 12.1) / linux-job	10m 3s
unittests-openx (3.9, 12.1) / linux-job	17m 4s
unittests-roboset (3.9, 12.1) / linux-job	7m 18s
unittests-sklearn (3.9, 12.1) / linux-job	5m 39s
unittests-smacv2 (3.9, 12.1) / linux-job	11m 57s
unittests-vd4rl (3.9, 12.1) / linux-job	8m 14s
unittests-vmas (3.9, 12.1) / linux-job	13m 2s
	2h 51m 5s

Provide feedback