Broke apart llms

This commit is contained in:
Paul Gauthier 2024-06-05 20:50:55 -07:00
parent 65f80e965f
commit c5e127d6fa
15 changed files with 444 additions and 384 deletions

27
website/docs/llms/groq.md Normal file
View file

@ -0,0 +1,27 @@
---
parent: Connecting to LLMs
nav_order: 400
---
# GROQ
Groq currently offers *free* API access to the models they host.
The Llama 3 70B model works
well with aider and is comparable to GPT-3.5 in code editing performance.
You'll need a [Groq API key](https://console.groq.com/keys).
To use **Llama3 70B**:
```
pip install aider-chat
export GROQ_API_KEY=<key> # Mac/Linux
setx GROQ_API_KEY <key> # Windows
aider --model groq/llama3-70b-8192
# List models available from Groq
aider --models groq/
```