Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FEAT / Bitsandbytes: Add dequantize API for bitsandbytes quantized models #30806

Merged
merged 11 commits into from
May 15, 2024
Merged

FEAT / Bitsandbytes: Add dequantize API for bitsandbytes quantized models #30806

merged 11 commits into from
May 15, 2024

Commits on May 14, 2024

  1. add method

    @younesbelkada
    younesbelkada committed May 14, 2024
    Configuration menu
    Copy the full SHA
    e0c39a9 View commit details
    Browse the repository at this point in the history

  2. change method name

    @younesbelkada
    younesbelkada committed May 14, 2024
    Configuration menu
    Copy the full SHA
    c748425 View commit details
    Browse the repository at this point in the history

  3. more comments

    @younesbelkada
    younesbelkada committed May 14, 2024
    Configuration menu
    Copy the full SHA
    14d51c2 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Apply suggestions from code review 

    Co-authored-by: Marc Sun <[email protected]>
Co-authored-by: amyeroberts <[email protected]>
    @younesbelkada @SunMarc @amyeroberts
    3 people authored May 15, 2024
    Configuration menu
    Copy the full SHA
    be7af7c View commit details
    Browse the repository at this point in the history

  2. fixup

    @younesbelkada
    younesbelkada committed May 15, 2024
    Configuration menu
    Copy the full SHA
    1cff84d View commit details
    Browse the repository at this point in the history

  3. add docstrings and fix comment

    @younesbelkada
    younesbelkada committed May 15, 2024
    Configuration menu
    Copy the full SHA
    ba01b82 View commit details
    Browse the repository at this point in the history

  4. warn users on the de-quantized dtype

    @younesbelkada
    younesbelkada committed May 15, 2024
    Configuration menu
    Copy the full SHA
    1a4a906 View commit details
    Browse the repository at this point in the history

  5. Update src/transformers/quantizers/base.py 

    Co-authored-by: Marc Sun <[email protected]>
    @younesbelkada @SunMarc
    younesbelkada and SunMarc authored May 15, 2024
    Configuration menu
    Copy the full SHA
    309581b View commit details
    Browse the repository at this point in the history

  6. Update src/transformers/integrations/bitsandbytes.py 

    Co-authored-by: amyeroberts <[email protected]>
    @younesbelkada @amyeroberts
    younesbelkada and amyeroberts authored May 15, 2024
    Configuration menu
    Copy the full SHA
    2813fb8 View commit details
    Browse the repository at this point in the history

  7. final suggestion - use private method

    @younesbelkada
    younesbelkada committed May 15, 2024
    Configuration menu
    Copy the full SHA
    8b904f7 View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'origin/main' into add-dequant

    @younesbelkada
    younesbelkada committed May 15, 2024
    Configuration menu
    Copy the full SHA
    7f17efa View commit details
    Browse the repository at this point in the history