New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FIX] EVA `meta` device check bug + add multi-gpu functionality #2218

Open

sirluk wants to merge 4 commits into huggingface:main from sirluk:eva_multi

+187 −13

Contributor

sirluk commented Nov 17, 2024

This PR contains

an important bugfix for a faulty device check in eva.py.
torch all_gather operations for all SVD Hooks to be able to leverage a higher batch size for EVA in multi-gpu setups.
An example in the docs for using EVA with multiple GPUs

sirluk added 4 commits

November 17, 2024 14:23


          - important bugfix for meta device check

bdac8d1

- add multi gpu functionality
- update docs


          add comment

b5d812c


          remove if

36727d0


          make style

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet