An AI sidekick that run on your own machine.
Gollama is a GUI application that allows you to quickly interact with OpenAI-compatible LLM API (like Ollama, OpenAI GPT,...).
gollama-demo.mp4
Currently, there is no prebuilt binary, so you have to build the app on your own machine.
You will need to install Go (1.18 or newer) and Wails CLI.
Clone the repository:
$ git clone https://github.com/huytd/gollama
$ cd gollama
And run the build command:
$ wails build
The gollama.app will be created in the ./build/bin folder. Copy it anywhere to run.
You have two options to use Gollama: With OpenAI API or with Ollama.
First, install and run Ollama (https://ollama.com/) on your machine. Then config the Gollama with the following information:
- API URL: http://localhost:11343/v1
- API Key: ollama
- API Model: whatever model you have with Ollama, for example,
mistral:latest
You will need to have the OpenAI API key. Config Gollama with the following information:
- API URL: https://api.openai.com/v1
- API Key: Your OpenAI API key
- API Model: gpt-3.5-turbo or whatever model you have access to