Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding BOFT: Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization #1326

Merged
merged 94 commits into from
Apr 12, 2024
Merged

Adding BOFT: Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization #1326

merged 94 commits into from
Apr 12, 2024

Commits on Nov 6, 2023

  1. update peft for boft release

    Zeju1997 committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    1d35f1e View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2023

  1. finished boft implementation, testing testing still required

    Zeju1997 committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    6126b88 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2023

  1. update for peft release

    Zeju1997 committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    c3c9d3f View commit details
    Browse the repository at this point in the history

Commits on Dec 1, 2023

  1. update peft boft for release

    Zeju1997 committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    b7e33ce View commit details
    Browse the repository at this point in the history

  2. update peft boft for release

    Zeju1997 committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    1dbcd92 View commit details
    Browse the repository at this point in the history

  3. update peft boft for release

    Zeju1997 committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    c1079e8 View commit details
    Browse the repository at this point in the history

  4. update

    Zeju1997 committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    cdacbc9 View commit details
    Browse the repository at this point in the history

  5. update

    Zeju1997 committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    4678666 View commit details
    Browse the repository at this point in the history

  6. update

    Zeju1997 committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    1864b87 View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2023

  1. update

    Zeju1997 committed Dec 2, 2023
    Configuration menu
    Copy the full SHA
    ba52330 View commit details
    Browse the repository at this point in the history

  2. update

    Zeju1997 committed Dec 2, 2023
    Configuration menu
    Copy the full SHA
    af3f02a View commit details
    Browse the repository at this point in the history

  3. update

    Zeju1997 committed Dec 2, 2023
    Configuration menu
    Copy the full SHA
    79ee1e2 View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2023

  1. update

    Zeju1997 committed Dec 3, 2023
    Configuration menu
    Copy the full SHA
    fbdc392 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2023

  1. update inference landmakr

    Zeju1997 committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    9e0f34e View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. update

    Zeju1997 committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    0370f8d View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2023

  1. update boft controlnet eval

    Zeju1997 committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    4e7a678 View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2023

  1. update

    Zeju1997 committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    478eddb View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2023

  1. update readme, fix src

    @yfeng95
    yfeng95 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    3b18cef View commit details
    Browse the repository at this point in the history

  2. add a bit test

    @yfeng95
    yfeng95 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    bb946e5 View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2023

  1. update

    Zeju1997 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    e50a00c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    4b37d4e View commit details
    Browse the repository at this point in the history

  3. update

    Zeju1997 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    d26582c View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. update for upstream merge

    Zeju1997 committed Jan 3, 2024
    Configuration menu
    Copy the full SHA
    96a06f0 View commit details
    Browse the repository at this point in the history

  2. update for upstream merge

    Zeju1997 committed Jan 3, 2024
    Configuration menu
    Copy the full SHA
    7dade8a View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2024

  1. update the docs of OFT, add the implementtion of BOFT

    @YuliangXiu
    Zeju1997 authored and YuliangXiu committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    1336eed View commit details
    Browse the repository at this point in the history

  2. fix the embedding saving for adaption prompt (huggingface#1314) 

    * fix the embedding saving for adaption prompt

* fix

* automate setting `save_embedding_layers` when embedding layer is resized during finetuning

* fix

* address comment

Co-Authored-By: Benjamin Bossan <[email protected]>

* oops

---------

Co-authored-by: Benjamin Bossan <[email protected]>
    @pacman100 @BenjaminBossan @YuliangXiu
    2 people authored and YuliangXiu committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    643b72e View commit details
    Browse the repository at this point in the history

  3. fix diffusers tests (huggingface#1317) 

    * fix diffusers tests

* quality
    @pacman100 @YuliangXiu
    pacman100 authored and YuliangXiu committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    21c16e3 View commit details
    Browse the repository at this point in the history

  4. update for BOFT PR

    @YuliangXiu
    Zeju1997 authored and YuliangXiu committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    a1635c3 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'huggingface:main' into main

    @YuliangXiu
    YuliangXiu authored Jan 8, 2024
    Configuration menu
    Copy the full SHA
    b721386 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2024

  1. Add boft cuda files into package data

    @yfeng95
    yfeng95 authored Jan 11, 2024
    Configuration menu
    Copy the full SHA
    6df7ebc View commit details
    Browse the repository at this point in the history

  2. update peft conv2d and improve code

    Zeju1997 committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    c64f4f2 View commit details
    Browse the repository at this point in the history

  3. update boft layer to avoid compiling cuda without using

    @yfeng95
    yfeng95 committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    547c2ed View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2024

  1. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    2cfd051 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    a4821f8 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    0227f21 View commit details
    Browse the repository at this point in the history

  4. add global to fix fbd import

    @yfeng95
    yfeng95 committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    659297c View commit details
    Browse the repository at this point in the history

Commits on Jan 13, 2024

  1. adding support for Conv2d, fixing bugs in tests, fixing typos accordi… 

    …ng to BenjaminBossan's suggestions, fixing installation issues with fdb_cuda
    Zeju1997 committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    f04b8f5 View commit details
    Browse the repository at this point in the history

  2. adding support for Conv2d, fixing bugs in tests, fixing typos accordi… 

    …ng to BenjaminBossan's suggestions, fixing installation issues with fdb_cuda
    Zeju1997 committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    4ea2347 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    660ac44 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    c2d6b01 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    8c13670 View commit details
    Browse the repository at this point in the history

  6. fetch upstream peft and solve conflict

    @yfeng95
    yfeng95 committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    1ab16a8 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. Merge branch 'huggingface:main' into main

    @YuliangXiu
    YuliangXiu authored Jan 31, 2024
    Configuration menu
    Copy the full SHA
    ca8f32c View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2024

  1. Merge branch 'huggingface:main' into main

    @YuliangXiu
    YuliangXiu authored and Zeju1997 committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    59f14cf View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    19d0dd5 View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. update the local peft to match the current version 27.02.2024

    @YuliangXiu
    Zeju Qiu authored and YuliangXiu committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    c89892e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 authored and Zeju1997 committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    5d35429 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    1963f6f View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2024

  1. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    da7e486 View commit details
    Browse the repository at this point in the history

  2. update for pull request

    Zeju1997 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    310657e View commit details
    Browse the repository at this point in the history

  3. update the local peft to match the current version 27.02.2024

    Zeju Qiu authored and Zeju1997 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    20b569d View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    46ca314 View commit details
    Browse the repository at this point in the history

  5. Update boft layer.py

    @Zeju1997
    Zeju1997 authored Mar 1, 2024
    Configuration menu
    Copy the full SHA
    b758153 View commit details
    Browse the repository at this point in the history

  6. Update test_custom_models.py boft

    @Zeju1997
    Zeju1997 authored Mar 1, 2024
    Configuration menu
    Copy the full SHA
    9c94269 View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'upstream/main'

    Zeju1997 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    288f3c7 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    a8f56b5 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 authored and Zeju1997 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    ba314c1 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    765bca7 View commit details
    Browse the repository at this point in the history

  11. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    d2d61b0 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    6a7499f View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. update BOFT scale/unscale function

    Zeju1997 committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    ae39cb1 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. fixing the newest commets

    Zeju1997 committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    70b21c4 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2024

  1. addressing newest issues

    Zeju1997 committed Mar 14, 2024
    Configuration menu
    Copy the full SHA
    f815ed2 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. addressing newest issues

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    d4b2e37 View commit details
    Browse the repository at this point in the history

  2. merge with master

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    f062ef6 View commit details
    Browse the repository at this point in the history

  3. running make style and passing make test

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    abced90 View commit details
    Browse the repository at this point in the history

  4. update code, adding readme, run make quality / make style using ruff=… 

    …=0.2.2 and hf-doc-builder==0.5.0
    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    1ae3f1f View commit details
    Browse the repository at this point in the history

  5. update for passing ruff

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    8f94aeb View commit details
    Browse the repository at this point in the history

  6. update for passing ruff

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    0fd4fba View commit details
    Browse the repository at this point in the history

  7. update for passing ruff

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    b50137c View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    90aef3d View commit details
    Browse the repository at this point in the history

  9. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    0d22102 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    efc810d View commit details
    Browse the repository at this point in the history

  11. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    e59038e View commit details
    Browse the repository at this point in the history

  12. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    d43c03a View commit details
    Browse the repository at this point in the history

  13. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    f9b8124 View commit details
    Browse the repository at this point in the history

  14. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    fde50cf View commit details
    Browse the repository at this point in the history

Commits on Mar 17, 2024

  1. fixing one small bug in the boft dreambooth example

    Zeju1997 committed Mar 17, 2024
    Configuration menu
    Copy the full SHA
    5cd542e View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. fixing one small bug in the boft dreambooth example

    Zeju1997 authored and Zeju1997 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    dad2a76 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/yfeng95/peft

    Zeju1997 committed Mar 19, 2024
    Configuration menu
    Copy the full SHA
    f7c42df View commit details
    Browse the repository at this point in the history

Commits on Mar 24, 2024

  1. fix fbd cuda

    @yfeng95
    yfeng95 committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    a62c471 View commit details
    Browse the repository at this point in the history

  2. add ninja

    @yfeng95
    yfeng95 committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    41cde3d View commit details
    Browse the repository at this point in the history

  3. update fdb cuda availability

    Zeju1997 committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    fcac773 View commit details
    Browse the repository at this point in the history

  4. Merged changes from upstream/main

    Zeju1997 committed Mar 24, 2024
    Configuration menu
    Copy the full SHA
    e23ff03 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. Merged changes from upstream/main

    Zeju1997 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    9cc42d0 View commit details
    Browse the repository at this point in the history

  2. updating boft for test decoder models

    Zeju1997 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    7943a9a View commit details
    Browse the repository at this point in the history

  3. update fdb cuda for passing tests

    Zeju1997 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    1deefbb View commit details
    Browse the repository at this point in the history

  4. fixing errors in make quality

    Zeju1997 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    9891c58 View commit details
    Browse the repository at this point in the history

  5. adding additional tests for boft conv2d

    Zeju1997 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    9d88096 View commit details
    Browse the repository at this point in the history

  6. update make style / quality

    Zeju1997 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    4d9b22c View commit details
    Browse the repository at this point in the history

  7. update small error

    Zeju1997 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    a3bd8af View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. update minor errors for BOFT release

    Zeju committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    13d7ec9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into main

    @Zeju1997
    Zeju1997 authored Apr 10, 2024
    Configuration menu
    Copy the full SHA
    c8527b9 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. running make style

    Zeju committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    8df1134 View commit details
    Browse the repository at this point in the history