MMagic v1.0.2 Release

Highlights

1. More detailed documentation

Thank you to the community contributors for helping us improve the documentation. We have improved many documents, including both Chinese and English versions. Please refer to the documentation for more details.

2. New algorithms

• Support Prompt-to-prompt, DDIM Inversion and Null-text Inversion. Click to View.

From right to left: origin image, DDIM inversion, Null-text inversion

Prompt-to-prompt Editing

cat -> dog

spider man -> iron man(attention replace)

Effel tower -> Effel tower at night (attention refine)

blossom sakura tree -> blossom(-3) sakura tree (attention reweight)

• Support Textual Inversion. Click to view.

• Support Attention Injection for more stable video generation with controlnet. Click to view.
• Support Stable Diffusion Inpainting. Click to view.

New Features & Improvements

• [Enhancement] Support noise offset in stable diffusion training by @LeoXing1996 in #1880
• [Community] Support Glide Upsampler by @Taited in #1663
• [Enhance] support controlnet inferencer by @Z-Fran in #1891
• [Feature] support Albumentations augmentation transformations and pipeline by @Z-Fran in #1894
• [Feature] Add Attention Injection for unet by @liuwenran in #1895
• [Enhance] update benchmark scripts by @Z-Fran in #1907
• [Enhancement] update mmagic docs by @crazysteeaam in #1920
• [Enhancement] Support Prompt-to-prompt, ddim inversion and null-text inversion by @FerryHuang in #1908
• [CodeCamp2023-302] Support MMagic visualization and write a user guide by @aptsunny in #1939
• [Feature] Support Textual Inversion by @LeoXing1996 in #1822
• [Feature] Support stable diffusion inpaint by @Taited in #1976
• [Enhancement] Adopt BaseModule for some models by @LeoXing1996 in #1543
• [MMSIG]支持 DeblurGANv2 inference by @xiaomile in #1955
• [CodeCamp2023-647] Add new configs of EG3D by @RangeKing in #1985

Bug Fixes

• Fix dtype error in StableDiffusion and DreamBooth training by @LeoXing1996 in #1879
• Fix gui VideoSlider bug by @Z-Fran in #1885
• Fix init_model and glide demo by @Z-Fran in #1888
• Fix InstColorization bug when dim=3 by @Z-Fran in #1901
• Fix sd and controlnet fp16 bugs by @Z-Fran in #1914
• Fix num_images_per_prompt in controlnet by @LeoXing1996 in #1936
• Revise metafile for sd-inpainting to fix inferencer init by @LeoXing1996 in #1995

New Contributors

• @wyyang23 made their first contribution in #1886
• @yehuixie made their first contribution in #1912
• @crazysteeaam made their first contribution in #1920
• @BUPT-NingXinyu made their first contribution in #1921
• @zhjunqin made their first contribution in #1918
• @xuesheng1031 made their first contribution in #1923
• @wslgqq277g made their first contribution in #1934
• @LYMDLUT made their first contribution in #1933
• @RangeKing made their first contribution in #1930
• @xin-li-67 made their first contribution in #1932
• @chg0901 made their first contribution in #1931
• @aptsunny made their first contribution in #1939
• @YanxingLiu made their first contribution in #1943
• @tackhwa made their first contribution in #1937
• @Geo-Chou made their first contribution in #1940
• @qsun1 made their first contribution in #1956
• @ththth888 made their first contribution in #1961
• @sijiua made their first contribution in #1967
• @MING-ZCH made their first contribution in #1982
• @AllYoung made their first contribution in #1996