multiple gpus training

[LLL-YUE]

I can't seem to use multiple gpus
There are two gpus in the setup, but training seems to be done on only one gpu causing out of memory
How can this situation be resolved?

[noelshin]

For this, you need to check how to use multiple GPUs with PyTorch. E.g., you can check: https://pytorch.org/tutorials/beginner/former_torchies/parallelism_tutorial.html

As to solve your out of memory issue, you could consider reducing the batch size.