Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support input_image as an array, fixing minor bug in the 'load_weights_from_pytorch_ckpt' method and adding colab demo showing it's usage #50

Merged
merged 4 commits into from
Oct 31, 2022

Conversation

costiash
Copy link
Contributor

@costiash costiash commented Oct 10, 2022

There is currently no support in "stable diffusion.py" for the case where "input_image" to the generator is not a path to an image, i.e., of type "str." The value of "input_image_tensor" will always remain "None" and the value of "input_image" will be disregarded if the value of "input_image" is an array. Added minor fix for this case.
Also, the default way of pytorch to load weights is to move them to the device they were saved from. so for making the method to work we need to specify to load the weights to the cpu or changing the line:
w = pt_weights['state_dict'][key].numpy()
to
w = pt_weights['state_dict'][key].cpu().numpy()

at least that was the case for me when trying to use this method on colab.

@costiash costiash changed the title support input_image as an array support input_image as an array and fixing minor bug in the 'load_weights_from_pytorch_ckpt' method Oct 30, 2022
Adding Colab Demo showing how to load pytorch ckpt weights from Hugging Face
@costiash
Copy link
Contributor Author

Added a Colab Demo to the README showing how to load new pytorch ckpt weights into the generator directly from Hugging Face.

@divamgupta divamgupta merged commit d740acd into divamgupta:master Oct 31, 2022
@costiash costiash changed the title support input_image as an array and fixing minor bug in the 'load_weights_from_pytorch_ckpt' method support input_image as an array, fixing minor bug in the 'load_weights_from_pytorch_ckpt' method and adding colab demo showing it's usage Oct 31, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants