Awesome
Chatbot Ollama
About
Chatbot Ollama is an open source chat UI for Ollama.
This project is based on chatbot-ui by Mckay Wrigley.
Updates
Chatbot Ollama will be updated over time.
Next up
- pull a model
- delete a model
- show model information
Docker
Build locally:
docker build -t chatbot-ollama .
docker run -p 3000:3000 chatbot-ollama
Pull from ghcr:
docker run -p 3000:3000 ghcr.io/ivanfioravanti/chatbot-ollama:main
Running Locally
1. Clone Repo
git clone https://github.com/ivanfioravanti/chatbot-ollama.git
2. Move to folder
cd chatbot-ollama
3. Install Dependencies
npm ci
4. Run Ollama server
Either via the cli:
ollama serve
or via the desktop client
5. Run App
npm run dev
6. Use It
You should be able to start chatting.
Configuration
When deploying the application, the following environment variables can be set:
Environment Variable | Default value | Description |
---|---|---|
DEFAULT_MODEL | mistral:latest | The default model to use on new conversations |
NEXT_PUBLIC_DEFAULT_SYSTEM_PROMPT | see here | The default system prompt to use on new conversations |
NEXT_PUBLIC_DEFAULT_TEMPERATURE | 1 | The default temperature to use on new conversations |
Contact
If you have any questions, feel free to reach out to me on X.