dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-25 23:05:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 5
aider/website/docs/llms/ollama.md
Paul Gauthier c5e127d6fa Broke apart llms
2024-06-05 20:50:55 -07:00

823 B
Raw Blame History

parent nav_order
Connecting to LLMs 500

Ollama

Aider can connect to local Ollama models.

# Pull the model
ollama pull <model>

# Start your ollama server
ollama serve

# In another terminal window...
pip install aider-chat

export OLLAMA_API_BASE=http://127.0.0.1:11434 # Mac/Linux
setx   OLLAMA_API_BASE http://127.0.0.1:11434 # Windows

aider --model ollama/<model>

In particular, llama3:70b works well with aider:

ollama pull llama3:70b
ollama serve

# In another terminal window...
export OLLAMA_API_BASE=http://127.0.0.1:11434 # Mac/Linux
setx   OLLAMA_API_BASE http://127.0.0.1:11434 # Windows

aider --model ollama/llama3:70b

See the model warnings section for information on warnings which will occur when working with models that aider is not familiar with.