Skip to content

Commit

Permalink
ggml : AVX2 support for Q4_0_8_8 (#8713)
Browse files Browse the repository at this point in the history
* Add AVX2 based implementations for quantize_q8_0_4x8, ggml_gemv_q4_0_8x8_q8_0 and ggml_gemm_q4_0_8x8_q8_0 functions

* Update code to fix issues occuring due to non alignment of elements to be processed as multiple of 16 in MSVC

* Update comments and indentation

* Make updates to reduce number of load instructions
  • Loading branch information
Srihari-mcw authored Sep 4, 2024
1 parent 5910ea9 commit 581c305
Showing 1 changed file with 612 additions and 0 deletions.
Loading

0 comments on commit 581c305

Please sign in to comment.