How to update the integrated ControlNET ?

[TomiTom1234]

Hi!

I just wanted to try "ip-Adapter" in ControlNet, but I can't find the "ip-adapter_face_id_plus" Preprocessor because it is not updated to the last version. How can I update CN to the last version?
I tried to intstall CN also but it keeps disabled because there is CN already integrated. Any idea please?

[2blackbar]

#97

[TomiTom1234]

#97

Nope, this is something different. I am not talking about the models, which I already saved in the ControlNET models folder, I am talking here about the preprocessor, which is not in the integrated CN because it is not on the last version.

[Moussack]

FaceID works pretty well for me. inside forge's CN the preprecesor is called "InsightFace+CLIP-H (IPAdapter)"

CONTROLNET:

INPUT IMAGE :

RESULTS :

[TomiTom1234]

Yes you are right, it is the only option as a Preprocessor for IP-Adapter, and as you said it works well, but still there are some messing IP-Adapters which I mentioned, which - maybe - means that the CN is not updated to the last version and there is no way to update it (I think) by ourselves.
I wish someone corrects me if I am wrong.

[nharwell]

Issue 179 is open on this problem - #179
Scroll to the screenshot & comments at the bottom.

[hoodady]

I donno but im getting really poor results:

[a3nima]

@hoodady dont forget to use the LORA ;-)

[CRCODE22]

Why does the built in control net not allow multiple input images? The external control net being used by automatic 1111 does allow that. When I install that extension in forge it will not allow you to use it because it keeps disabling it automatically even when I check it to be enabled.

[CRCODE22]

The main controlnet is much better than the build in one because the build in one does not have multi input feature which the main branch has which you can see below but forge will not allow you to use it but automatic 1111 does.

[a3nima]

in forge you can use a mask and put 2 characters on one image. not possible with A1111. BUT still no multi image input in main branch of forge :(

[nekrophiliaki]

Do you have more information on how to do this? I have used Composable Lora with poor results.

[fonik000]

I have a temporary alternative:

1. Download the original controlnet.
2. To be on the safe side, make a copy of the folder: sd_forge_controlnet
3. Copy the files of the original controlnet into the folder: sd_forge_controlnet and overwrite all files.
4. Now you have the latest version of controlnet. You will now see face-id as the preprocessor.

[the0ckid82]

did this work for you ?

[TomiTom1234]

Somehow the recommendation of fonik000 worked to show the exact same options and preprocessors that the original CN has, but there were some errors here and there, so I decided to go back to the integrated CN, and to be honest after testing I see that the pre-installed preprocessor in this integrated CN "InsightFace+CLIP-H (IPAdapter)" does pretty good - if not better - job than the "ip-adapter_face_id_plus" preprocessor.

[a3nima]

its not preinstalled, it has to be downloaded ;) but you're right the preprocessor you mentioned works well :)

[escmaster]

Thank you so much, I'm already try another version of SD but with your instruction, I can go back using SD-Forge!!! Works like a charm for me!! Even fix a lot of errors that I'm getting from controlnet maybe because was outdated.

[lllyasviel]

Hi please note that the previous naming of ipadapters preprocessors in sd-webui-controlnet were wrong.
The names in Forge are correct and consistent to official naming from ipadapter official :

SD v.	IPadapter	Img encoder
v1.5	ip-adapter_sd15	ViT-H
v1.5	ip-adapter_sd15_light	ViT-H
v1.5	ip-adapter-plus_sd15	ViT-H
v1.5	ip-adapter-plus-face_sd15	ViT-H
v1.5	ip-adapter-full-face_sd15	ViT-H
v1.5	ip-adapter_sd15_vit-G	ViT-bigG
SDXL	ip-adapter_sdxl	ViT-bigG
SDXL	ip-adapter_sdxl_vit-h	ViT-H
SDXL	ip-adapter-plus_sdxl_vit-h	ViT-H
SDXL	ip-adapter-plus-face_sdxl_vit-h	ViT-H
v1.5	FaceID	InsightFace+CLIP-H
v1.5	FaceID Plus	InsightFace+CLIP-H
v1.5	FaceID Plus v2	InsightFace+CLIP-H
v1.5	FaceID Portrait	InsightFace+CLIP-H
SDXL	FaceID	InsightFace+CLIP-H
SDXL	FaceID Plus v2	ViT-H

[Vincentdu-cn]

If you use IP-Adapter with CLIP-ViT-H (IPAdapter),when I run preprocessor,every time it will download model.safetensors from huggingface,but I have already download the file,and rename CLIP-ViT-H-14.safetensors.
Then I use InsightFace+CLIP-H (IPAdapter),it will also download the same file.

Finally got stuck at this download step.

Begin to load 1 model
Moving model(s) has taken 0.02 seconds
Model loaded in 16.1s (load weights from disk: 2.1s, forge load real models: 11.5s, forge finalize: 0.1s, load VAE: 0.2s, calculate empty prompt: 1.9s).
2024-03-17 14:57:06,498 - ControlNet - INFO - Preview Resolution = 512
Downloading: "https://huggingface.co/h94/IP-Adapter/resolve/main/models/image_encoder/model.safetensors" to /home/stable-diffusion-webui-forge/models/ControlNetPreprocessor/CLIP-ViT-H-14.safetensors

[ely1113]

Where can I download InsightFace+CLIP-H? I can't find it anywhere.

[Vincentdu-cn]

https://huggingface.co/h94/IP-Adapter/resolve/main/models/image_encoder/model.safetensors?download=true

[DiegoRRR]

SD v. IPadapter Img encoder (...)

In which folder do I put these files? I put them in "ControlNetPreprocessor" but they don't appear.

[ssbugman]

Hi please note that the previous naming of ipadapters preprocessors in sd-webui-controlnet were wrong. The names in Forge are correct and consistent to official naming from ipadapter official :

SDXL FaceID Plus v2 ViT-H

ViT-H requires Insightface howi nstall it?
InsightFace+CLIP-H dont working with SDXL models and returns messed mutated face.

[gohan2091]

So in XL, if I want to use FaceID Plus v2, I need to select ViT-H? because when I do that, the face doesn't transfer to the image, it's ignored. I have to use InsightFace+CLIP-H and then it works

[foychermin]

is there a fix for openpose and forges controlnet yet?

[TheCodeSlinger]

Here I made a multi-input for when using IpAdapter in the built in control net. I'm still not impressed with the results compared to the official control net version when using Automatic1111's, but maybe someone wants to look at the code and has some suggestions.

https://github.com/TheCodeSlinger/ForgeUI-IPAdapter-MultiInput