Skip to content

Releases: oobabooga/llama-cpp-python-cuBLAS-wheels

wheels

13 Dec 17:34
@github-actions github-actions
wheels
beb1b54
Compare
Choose a tag to compare
wheels 
Add -DLLAMA_CUDA_FORCE_MMQ=ON option
Assets 147
Loading

textgen-webui

13 Dec 17:34
@github-actions github-actions
textgen-webui
beb1b54
Compare
Choose a tag to compare
textgen-webui Latest
Latest 
Add -DLLAMA_CUDA_FORCE_MMQ=ON option
Assets 2,834

rocm

13 Dec 17:31
@github-actions github-actions
rocm
beb1b54
Compare
Choose a tag to compare
rocm 
Add -DLLAMA_CUDA_FORCE_MMQ=ON option
Assets 365
Loading

metal

19 Dec 14:26
@github-actions github-actions
metal
beb1b54
Compare
Choose a tag to compare
metal 
Add -DLLAMA_CUDA_FORCE_MMQ=ON option
Assets 1,199
Loading

cpu

13 Dec 17:24
@github-actions github-actions
cpu
beb1b54
Compare
Choose a tag to compare
cpu 
Add -DLLAMA_CUDA_FORCE_MMQ=ON option
Assets 562
Loading

basic

13 Dec 17:34
@github-actions github-actions
basic
beb1b54
Compare
Choose a tag to compare
basic 
Add -DLLAMA_CUDA_FORCE_MMQ=ON option
Assets 147
Loading

AVX512

13 Dec 17:34
@github-actions github-actions
AVX512
beb1b54
Compare
Choose a tag to compare
AVX512 
Add -DLLAMA_CUDA_FORCE_MMQ=ON option
Assets 147
Loading

AVX

13 Dec 17:34
@github-actions github-actions
AVX
beb1b54
Compare
Choose a tag to compare
AVX 
Add -DLLAMA_CUDA_FORCE_MMQ=ON option
Assets 146
Loading