LLAMACPP

AI Provider: llama.cpp

• llama.cpp

• Agent-LLM

Quick Start Guide

Note: AI_MODEL should stay default unless there is a folder in model-prompts specific to the model that you're using. You can also create one and add your own prompts.

Update your agent settings

1. Make sure your model is placed in the folder models/

2. Create a new agent

3. Set AI_PROVIDER to llamacpp.

4. Set MODEL_PATH to the path of your llama.cpp model (for docker containers models/ is mapped to /model)