Update peft requirement from ==0.5.* to ==0.6.*

[dependabot]

Updates the requirements on peft to permit the latest version.

Release notes

Sourced from peft's releases.

🧨 Diffusers now uses 🤗 PEFT, new tuning methods, better quantization support, higher flexibility and more

Highlights

Integration with diffusers

🧨 Diffusers now leverage PEFT as a backend for LoRA inference for Stable Diffusion models (#873, #993, #961). Relevant PRs on 🧨 Diffusers are huggingface/diffusers#5058, huggingface/diffusers#5147, huggingface/diffusers#5151 and huggingface/diffusers#5359. This helps in unlocking a vast number of practically demanding use cases around adapter-based inference 🚀. Now you can do the following with easy-to-use APIs and it supports different checkpoint formats (Diffusers format, Kohya format ...):

1. use multiple LoRAs
2. switch between them instantaneously
3. scale and combine them
4. merge/unmerge
5. enable/disable

For details, refer to the documentation at Inference with PEFT.

New tuning methods

• Multitask Prompt Tuning: Thanks @​mayank31398 for implementing this method from https://arxiv.org/abs/2303.02861 (#400)
• LoHa (low-rank Hadamard product): @​kovalexal did a great job adding LoHa from https://arxiv.org/abs/2108.06098 (#956)
• LoKr (Kronecker Adapter): Not happy with just one new adapter, @​kovalexal also added LoKr from https://arxiv.org/abs/2212.10650 to PEFT (#978)

Other notable additions

• Allow merging of LoRA weights when using 4bit and 8bit quantization (bitsandbytes), thanks to @​jiqing-feng (#851, #875)
• IA³ now supports 4bit quantization thanks to @​His-Wardship (#864)
• We increased the speed of adapter layer initialization: This should be most notable when creating a PEFT LoRA model on top of a large base model (#887, #915, #994)
• More fine-grained control when configuring LoRA: It is now possible to have different ranks and alpha values for different layers (#873)

Experimental features

• For some adapters like LoRA, it is now possible to activate multiple adapters at the same time (#873)

Breaking changes

• It is no longer allowed to create a LoRA adapter with rank 0 (r=0). This used to be possible, in which case the adapter was ignored.

What's Changed

As always, a bunch of small improvements, bug fixes and doc improvements were added. We thank all the external contributors, both new and recurring. Below is the list of all changes since the last release.

• Fixed typos in custom_models.mdx by @​Psancs05 in huggingface/peft#847
• Release version 0.6.0.dev0 by @​pacman100 in huggingface/peft#849
• DOC: Add a contribution guide by @​BenjaminBossan in huggingface/peft#848
• clarify the new model size by @​stas00 in huggingface/peft#839
• DOC: Remove backlog section from README.md by @​BenjaminBossan in huggingface/peft#853
• MNT: Refactor tuner forward methods for simplicity by @​BenjaminBossan in huggingface/peft#833
• 🎉 Add Multitask Prompt Tuning by @​mayank31398 in huggingface/peft#400
• Fix typos in ia3.py by @​metaprotium in huggingface/peft#844
• Support merge lora module for 4bit and 8bit linear by @​jiqing-feng in huggingface/peft#851

... (truncated)

Commits

• 02f0a4c Release version 0.6.0 (#1072)
• 23cfbf2 Fix slow tests not running (#1071)
• 9da72d2 Fix Slack bot not displaying error messages (#1068)
• 0ad95fa TST test coverage for layer matching (#1031)
• 6960076 [tests] Update Dockerfile to use cuda 12.2 (#1050)
• bdeb06b [core] Fix use_reentrant issues (#1036)
• 884b1ac Add implementation of LyCORIS LoKr for SD&SDXL models (#978)
• 207229a FIX Conv1D merge error for IA3 (#1014)
• 2464c57 FIX setting active adapter correctly (#1051)
• 8b21a4e DOC fix wrong import in p-tuning docs (#1049)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)