New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Add npu support for nf4 quantization #1416

Closed

statelesshz wants to merge 2 commits into bitsandbytes-foundation:multi-backend-refactor from statelesshz:npu-backend

statelesshz commented Nov 16, 2024 •

edited

Loading

Collaborators

statelesshz marked this pull request as draft

November 16, 2024 09:45

statelesshz force-pushed the npu-backend branch 7 times, most recently from dc4cf79 to fec7b14 Compare

November 16, 2024 11:28


          Add npu support for nf4 quantization

Co-authored-by: Slightwind <[email protected]>
Co-authored-by: Ginray <[email protected]>

statelesshz force-pushed the npu-backend branch 3 times, most recently from 6785243 to 9229e4b Compare

November 16, 2024 11:31


          remove quantize

a1b3bcb

statelesshz force-pushed the npu-backend branch from 9229e4b to a1b3bcb Compare

November 16, 2024 11:32

statelesshz closed this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet