Skip to content

Commit

Permalink
Merge pull request #295 from KonradHoeffner/patch-3
Browse files Browse the repository at this point in the history
remove manual AutoGPTQ instruction step from README.md
  • Loading branch information
PromtEngineer authored Jul 29, 2023
2 parents 84e1604 + 29ba48c commit af2d3f8
Showing 1 changed file with 0 additions and 11 deletions.
11 changes: 0 additions & 11 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,17 +38,6 @@ If you want to use BLAS or Metal with [llama-cpp](<(https://github.com/abetlen/l
CMAKE_ARGS="-DLLAMA_CUBLAS=on" FORCE_CMAKE=1 pip install -r requirements.txt
```

Then install AutoGPTQ - if you want to run quantized models for GPU

```shell
git clone https://github.com/PanQiWei/AutoGPTQ.git
cd AutoGPTQ
git checkout v0.2.2
pip install .
```

For more support on [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ).

## Test dataset

This repo uses a [Constitution of USA ](https://constitutioncenter.org/media/files/constitution.pdf) as an example.
Expand Down

0 comments on commit af2d3f8

Please sign in to comment.