Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FastAPI endpoints for managing trainer as a service #969

Merged
merged 50 commits into from
Sep 23, 2024
Merged

FastAPI endpoints for managing trainer as a service #969

merged 50 commits into from
Sep 23, 2024

Conversation

bghira
Copy link
Owner

@bghira bghira commented Sep 14, 2024

No description provided.

bghira and others added 22 commits September 8, 2024 13:23
wip
2336b0a
FastAPI endpoints for starting and cancelling training
e9cd39b
fastapi: updates for proper starting/stopping of jobs
5d5d26a
update gitignore to exclude webui files
16f28e5
re-add the missing lokr init norm option, ignore state files
0ea42bc
VAECache: improve startup speed for extremely large datasets
df6a82c
sine: update to use math.sin instead
a3cb5f3
@anae-git
Update FLUX.md
69a797a 
Fix unfortunate typo that will confuse people
Fix #953 by updating stable_diffusion_3 to sd3 for v1.0 config changes
9946b17
Fix #961 by instantiating the batch fetcher with the step count and i…
c5c72c4 
…ncrementing locally instead of globally
(#962) initialise self.optimizer instead of optimizer for deepspeed
ded5eb0
wip
c06a545
apple: update lockfile
a8d22e2
add trainer message when we fail
3c506e4
fastapi dep
6808a0b
fastapi dep
0ac5139
sdk: lycoris config, locking issues
23423f6
update all core dependencies
f4070dc
update poetry metadata
03ba7c5
update default write batch size for text embeds
f8c0ea3
optimizer config args printed should be corrected
cf28ced
Merge branch 'main' of ssh://github.com/bghira/SimpleTuner into featu…
cc82914 
…re/fastapi-endpoints
bghira added 21 commits September 16, 2024 17:47
sdk comments improved
fd42548
webhook should send timestamp with the raw request
94a7bc5
vae caching should nuke the process when OOMing
a15f2a5
webhooks: add mixin to vae cache and report progress
42dabfc 
Authored-by: @ryneandal
update dependencies
5a4cc56
use aws_data_prefix or cache_dir
b588602
use default value for prefix
3c0dba3
update warning/error msg
0a25268
vae cache subfolder detection refactor
8c62019
vae cache test for filename mapping, subdir transfer
8878296
reintroduce changes for webhook handler
cc8e3cb
quanto: allow quantising on GPU by default (faster)
593ab78
text embed cache progress updates via webhook
049cd60
print output only on main thread
e253bb6
print tf32 messages only once
430422b
print the quantisation device in use
a9117b5
vae cache logs should print only on the main rank
af25bf0
send the unet or transformer to the accelerator even if the dtype is …
15dc4fb 
…correct
update dependencies
73b4f58
clean up log lines
c15e172
remove 2nd unnecessary call to create_directory
9a4d8de
@bghira bghira marked this pull request as ready for review September 23, 2024 20:19
@bghira bghira merged commit 909e347 into main Sep 23, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@bghira @anae-git