Broke apart llms

This commit is contained in:
Paul Gauthier 2024-06-05 20:50:55 -07:00
parent 65f80e965f
commit c5e127d6fa
15 changed files with 444 additions and 384 deletions

View file

@ -0,0 +1,35 @@
---
parent: Connecting to LLMs
nav_order: 500
---
# OpenRouter
Aider can connect to [models provided by OpenRouter](https://openrouter.ai/models?o=top-weekly):
You'll need an [OpenRouter API key](https://openrouter.ai/keys).
```
pip install aider-chat
export OPENROUTER_API_KEY=<key> # Mac/Linux
setx OPENROUTER_API_KEY <key> # Windows
# Or any other open router model
aider --model openrouter/<provider>/<model>
# List models available from OpenRouter
aider --models openrouter/
```
In particular, Llama3 70B works well with aider, at low cost:
```
pip install aider-chat
export OPENROUTER_API_KEY=<key> # Mac/Linux
setx OPENROUTER_API_KEY <key> # Windows
aider --model openrouter/meta-llama/llama-3-70b-instruct
```