Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How exactly do you use this with Comfy? Saw the update, but where is the node? #14

Open
CCpt5 opened this issue Mar 13, 2024 · 8 comments

Comments

@CCpt5
Copy link

CCpt5 commented Mar 13, 2024

Hi!

First of all, thanks for your work!

I noticed you pushed an update today saying this can now be used in comfy. I cloned the repo to the custom_nodes folder but nothing is installed (error: Cannot import D:\SDXL\ComfyUI\custom_nodes\resadapter module for custom nodes: [Errno 2] No such file or directory: 'D:\SDXL\ComfyUI\custom_nodes\resadapter\init.py')

The workflows don't seem to load for me either with a drag/drop nor donwload/open.

Can you provide a step by step to get the workflow shows in your .PNGs like:

resadapter-1024x1024

@jiaxiangc
Copy link
Collaborator

jiaxiangc commented Mar 14, 2024

tanks for your attention.

We are pleased to announce that ComfyUI-ResAdapter is complete and users can install it to load the weights of ResAdapter.

However, due to the internal arrangement of our company, we will postpone open-sourcing the code of ComfyUI-ResAdapter for some time. We will open source it as soon as possible, please pay attention to us for the first time to obtain codes.

After opening source it, I will give detaled information to help users step by step.

@blepping
Copy link

blepping commented Mar 25, 2024

i made an experimental node to apply the unet patch: https://github.com/blepping/ComfyUI-ApplyResAdapterUnet

Previous GIST link: https://gist.github.com/blepping/5e5d54d5d01ab725d945108127ce8c83

i'm not sure if it's correct but it seems to roughly do what i'd expect. put the resolution normalization model in models/unet, load the LoRA normally:

image

edit: Updated to point to the repo (no functional difference currently, just easier to install via ComfyUI's manager).

@jiaxiangc
Copy link
Collaborator

i made an experimental node to apply the unet patch: https://gist.github.com/blepping/5e5d54d5d01ab725d945108127ce8c83

i'm not sure if it's correct but it seems to roughly do what i'd expect. put the resolution normalization model in models/unet, load the LoRA normally:

image

Hi, can you provide examples for exact model? such as dreamlike-diffusion-1.0?

@blepping
Copy link

@jiaxiangc sure, here is a comparison using dreamlike-diffusion-1.0. top batch of 4 is with the LoRA and unet patch, bottom is without. the workflow image also contains the workflow metadata and can be loaded in ComfyUI. it seems to be working properly since the results look similar to your demonstration.

resnetcomparisonworkflow

@blepping
Copy link

i put the unet patch node in a repo for easier use. there is no functional difference compared to the gist (so far, anyway): https://github.com/blepping/ComfyUI-ApplyResAdapterUnet

@jiaxiangc
Copy link
Collaborator

@CCpt5
There are some people to contribute to ComfyUI-ResAdapter, i will pull requests in this month.

@jiaxiangc
Copy link
Collaborator

i put the unet patch node in a repo for easier use. there is no functional difference compared to the gist (so far, anyway): https://github.com/blepping/ComfyUI-ApplyResAdapterUnet

Thanks for your contribution, i will put a link for your project on our README.md.

@jiaxiangc
Copy link
Collaborator

We have released the code about ComfyUI-ResAdapter.

@jiaxiangc jiaxiangc reopened this Apr 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants