Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

create a lightweight training framework #43

Closed
CarloLucibello opened this issue Apr 8, 2023 · 1 comment · Fixed by #44
Closed

create a lightweight training framework #43

CarloLucibello opened this issue Apr 8, 2023 · 1 comment · Fixed by #44

Comments

@CarloLucibello
Copy link
Owner

CarloLucibello commented Apr 8, 2023

We should have an interface that involves only minimal changes with respect to plain flux code but that allows easy training on different devices, distributed training and mixed precision.
Something similar to
huggingface's accelerate
or
lighting's fabric (see also a simplified implementation of the Trainer based on Fabric)

@CarloLucibello
Copy link
Owner Author

A good name for the accelerator could be Foil

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant