Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Supporting new diffusers #4

Open
TonyLianLong opened this issue Mar 22, 2024 · 5 comments
Open

Supporting new diffusers #4

TonyLianLong opened this issue Mar 22, 2024 · 5 comments

Comments

@TonyLianLong
Copy link

Thanks for the great work! However, the pipeline does not seem to support the latest diffusers. When I use diffusers v0.25.0, I got:

  File "/home_dir/miniconda3/envs/env_name/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
    raise self._exception
  File "/home_dir/miniconda3/envs/env_name/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home_dir/MIGC/migc_gui/app.py", line 82, in process_request
    pipe = offlinePipelineSetupWithSafeTensor(sd_safetensors_path=sd_safetensors_path)
  File "/home_dir/MIGC/migc/migc_utils.py", line 174, in offlinePipelineSetupWithSafeTensor
    pipe = StableDiffusionMIGCPipeline.from_single_file(sd_safetensors_path,
  File "/home_dir/miniconda3/envs/env_name/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn
    return fn(*args, **kwargs)
  File "/home_dir/miniconda3/envs/env_name/lib/python3.10/site-packages/diffusers/loaders/single_file.py", line 263, in from_single_file
    pipe = download_from_original_stable_diffusion_ckpt(
  File "/home_dir/miniconda3/envs/env_name/lib/python3.10/site-packages/diffusers/pipelines/stable_diffusion/convert_from_ckpt.py", line 1687, in download_from_original_stable_diffusion_ckpt
    pipe = pipeline_class(
  File "/home_dir/MIGC/migc/migc_pipeline.py", line 241, in __init__
    super().__init__(
  File "/home_dir/miniconda3/envs/env_name/lib/python3.10/site-packages/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py", line 237, in __init__
    self.register_modules(
  File "/home_dir/miniconda3/envs/env_name/lib/python3.10/site-packages/diffusers/pipelines/pipeline_utils.py", line 571, in register_modules
    library = not_compiled_module.__module__.split(".")[0]
AttributeError: 'bool' object has no attribute '__module__'

This is similar to the following error:
huggingface/diffusers#6094

The solution is discussed here:
huggingface/diffusers#5993 (comment)

Are you interested in solving this and making MIGC compatible with the updated diffusers?

@limuloo
Copy link
Owner

limuloo commented Mar 23, 2024

@TonyLianLong Thank you for your attention and recognition of our work!
Following your suggestions, we have made modifications to the relevant code. Currently, MIGC is compatible with diffusers v0.25.0. 😄 If you have any further questions or issues, please feel free to contact me here.

@akk-123
Copy link

akk-123 commented Mar 25, 2024

@limuloo can you support migc with controlnet?

@limuloo
Copy link
Owner

limuloo commented Mar 26, 2024

@akk-123 Thank you for your suggestion. We also think that combining MIGC and ControlNet will bring even better applications.
However, we are currently expanding MIGC in other dimensions. Plans to integrate ControlNet with MIGC may be slightly delayed.
Anyway, stay tuned!

@akk-123
Copy link

akk-123 commented Mar 26, 2024

Thank you, look forward to your updates, can you let me know your follow-up update plans?

@limuloo
Copy link
Owner

limuloo commented Mar 27, 2024

@akk-123 (1) The control forms of MIGC will become more diverse. (2) Give MIGC stronger control capabilities. (3) Enhance MIGC’s image editing capabilities. Stay tuned!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants