support input_image as an array, fixing minor bug in the 'load_weights_from_pytorch_ckpt' method and adding colab demo showing it's usage #50
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There is currently no support in "stable diffusion.py" for the case where "input_image" to the generator is not a path to an image, i.e., of type "str." The value of "input_image_tensor" will always remain "None" and the value of "input_image" will be disregarded if the value of "input_image" is an array. Added minor fix for this case.
Also, the default way of pytorch to load weights is to move them to the device they were saved from. so for making the method to work we need to specify to load the weights to the cpu or changing the line:
w = pt_weights['state_dict'][key].numpy()
to
w = pt_weights['state_dict'][key].cpu().numpy()
at least that was the case for me when trying to use this method on colab.