> For the complete documentation index, see [llms.txt](https://agent-llm.gitbook.io/docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://agent-llm.gitbook.io/docs/providers/llamacpp.md).

# LLAMACPP

## AI Provider: llama.cpp

* [llama.cpp](https://github.com/ggerganov/llama.cpp)
* [Agent-LLM](https://github.com/Josh-XT/Agent-LLM)

## Quick Start Guide

*Note: AI\_MODEL should stay `default` unless there is a folder in `model-prompts` specific to the model that you're using. You can also create one and add your own prompts.*

### Update your agent settings

1. Make sure your model is placed in the folder `models/`
2. Create a new agent
3. Set `AI_PROVIDER` to `llamacpp`.
4. Set `MODEL_PATH` to the path of your llama.cpp model (for docker containers `models/` is mapped to `/model`)