Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How alpha masks are handled? #24

Open
PGCRT opened this issue Dec 20, 2024 · 3 comments
Open

How alpha masks are handled? #24

PGCRT opened this issue Dec 20, 2024 · 3 comments

Comments

@PGCRT
Copy link

PGCRT commented Dec 20, 2024

With Kohya scripts, I use --alpha_masks argument to ignore masked areas, mostly watermarks or unwanted parts of the image that I don't want the training to focus on.

I would like to know if this feature is present (For HunyuanVideo training on diffusion-pipe), if it needs special configuration or if it's natively supported, Thank you

@tdrussell
Copy link
Owner

It doesn't currently support any kind of masks.

@PGCRT
Copy link
Author

PGCRT commented Dec 21, 2024

Okay, so the alpha masks will either be ignored as if they aren't there or treated as black areas, resulting in black squares or shapes during inference? Thank you for your time

@tdrussell
Copy link
Owner

I'm not sure how this feature works in Kohya sd-scripts. Are the masks separate? Or is it part of the image itself as an alpha channel? For diffusion-pipe if an image has alpha channel, the transparent parts are converted to white (as usually that is the background). But they are not masked in the loss function.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants