diff --git a/README.md b/README.md index 07287ca96200e..c4837f2adc1a7 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,4 @@ -# llama-for-kobold +# llamacpp-for-kobold A self contained distributable from Concedo that exposes llama.cpp function bindings, allowing it to be used via a simulated Kobold API endpoint. @@ -8,7 +8,7 @@ What does it mean? You get llama.cpp with a fancy UI, persistent stories, editin ## Usage - [Download the latest release here](https://github.com/LostRuins/llamacpp-for-kobold/releases/latest) or clone the repo. -- Windows binaries are provided in the form of **llamacpp-for-kobold.exe**, which is a pyinstaller wrapper for **llamacpp.dll** and **llama-for-kobold.py**. If you feel concerned, you may prefer to rebuild it yourself with the provided makefiles and scripts. +- Windows binaries are provided in the form of **llamacpp-for-kobold.exe**, which is a pyinstaller wrapper for **llamacpp.dll** and **llamacpp_for_kobold.py**. If you feel concerned, you may prefer to rebuild it yourself with the provided makefiles and scripts. - Weights are not included, you can use the `quantize.exe` to generate them from your official weight files (or download them from other places). - To run, execute **llamacpp-for-kobold.exe** or drag and drop your quantized `ggml_model.bin` file onto the .exe, and then connect with Kobold or Kobold Lite. - By default, you can connect to http://localhost:5001 @@ -17,7 +17,7 @@ What does it mean? You get llama.cpp with a fancy UI, persistent stories, editin ## OSX and Linux - You will have to compile your binaries from source. A makefile is provided, simply run `make` -- After all binaries are built, you can run the python script with the command `llama_for_kobold.py [ggml_model.bin] [port]` +- After all binaries are built, you can run the python script with the command `llamacpp_for_kobold.py [ggml_model.bin] [port]` ## Considerations - Don't want to use pybind11 due to dependencies on MSVCC diff --git a/llama_for_kobold.py b/llamacpp_for_kobold.py similarity index 100% rename from llama_for_kobold.py rename to llamacpp_for_kobold.py diff --git a/make_pyinstaller.bat b/make_pyinstaller.bat index 6091c10e793d9..6be8d12e99514 100644 --- a/make_pyinstaller.bat +++ b/make_pyinstaller.bat @@ -1 +1 @@ -pyinstaller --noconfirm --onefile --console --icon "./niko.ico" --add-data "./klite.embd;." --add-data "./llamacpp.dll;." --add-data "./llamacpp_blas.dll;." --add-data "./libopenblas.dll;." "./llama_for_kobold.py" -n "llamacpp-for-kobold.exe" \ No newline at end of file +pyinstaller --noconfirm --onefile --console --icon "./niko.ico" --add-data "./klite.embd;." --add-data "./llamacpp.dll;." --add-data "./llamacpp_blas.dll;." --add-data "./libopenblas.dll;." "./llamacpp_for_kobold.py" -n "llamacpp-for-kobold.exe" \ No newline at end of file