A local RAG agent you can add documents to and ask questions about. Still a work in progress.
- Clone repo with LLM:
git clone --recurse-submodules https://github.com/rasmussvala/Local-RAG-Agent.git - Create virtual environment:
py -m venv .venv - Activate virtual environment (Windows):
.\.venv\Scripts\activate - Install requirements:
- Without CUDA:
pip install -r .\requirements.txt - With CUDA:
pip install -r .\requirements_cuda.txt
- Without CUDA:
To add documents to the chatbot you need to do the following:
- Replace example documents in the documents folder (right now .txt is only supported).
- Run the proccess documents script to embed documents so chatbot can find them.
py .\proccess_documents.py
To chat with the chatbot you run the script
py .\main.py
The chatbot as of now only finds relevant documents in the first query. If you want the chatbot to find new documents you new to start a new session.
- Create a command "restart" to restart chat
- GUI