[Feature] TorchRL2Gym conversion #8806

Job	Run time
build-wheel-linux (3.8, cp38-cp38, --index-url https://download.pytorch.org/whl/cpu, "['cpu', '11...	1m 29s
build-wheel-mac (3.8, 3.8)	1m 43s
build-wheel-windows (3.8, 3.8)	3m 49s
build-wheel-mac (3.9, 3.9)	1m 41s
build-wheel-linux (3.9, cp39-cp39, --index-url https://download.pytorch.org/whl/cpu, "['cpu', '11...	1m 30s
build-wheel-windows (3.9, 3.9)	2m 29s
build-wheel-mac (3.10, 3.10.3)	1m 47s
build-wheel-linux (3.10, cp310-cp310, --index-url https://download.pytorch.org/whl/cpu, "['cpu', ...	1m 32s
build-wheel-windows (3.10, 3.10.3)	3m 48s
build-wheel-linux (3.11, cp311-cp311, --index-url https://download.pytorch.org/whl/cpu, "['cpu', ...	1m 42s
build-wheel-windows (3.11, 3.11)	3m 18s
build-wheel-mac (3.11, 3.11)	1m 28s
test-wheel (linux, ubuntu-20.04, 3.8)	2m 4s
test-wheel (linux, ubuntu-20.04, 3.9)	2m 11s
test-wheel (linux, ubuntu-20.04, 3.10)	2m 33s
test-wheel (linux, ubuntu-20.04, 3.11)	2m 8s
test-wheel (mac, macos-latest, 3.8)	2m 53s
test-wheel (mac, macos-latest, 3.9)	2m 19s
test-wheel (mac, macos-latest, 3.10)	2m 27s
test-wheel (mac, macos-latest, 3.11)	2m 46s
test-wheel-windows (3.8)	7m 29s
test-wheel-windows (3.9)	5m 10s
test-wheel-windows (3.10)	3m 34s
test-wheel-windows (3.11)	5m 36s
	1h 7m 26s

Provide feedback