This commit is contained in:
Paul Gauthier 2024-04-22 12:27:44 -07:00
parent 1ea2b56356
commit f1ce673f78

View file

@ -9,7 +9,8 @@ Aider also works quite well with [GPT-3.5](#openai).
To use aider with a *free* API provider, you can use [Groq's Llama 3 70B](#llama3) To use aider with a *free* API provider, you can use [Groq's Llama 3 70B](#llama3)
which is comparable to GPT-3.5 in code editing performance. which is comparable to GPT-3.5 in code editing performance.
Cohere also offers free API access to their [Command-R+ model](#cohere), which works with aider Cohere also offers free API access to their [Command-R+ model](#cohere),
which works with aider
as a *very basic* coding assistant. as a *very basic* coding assistant.
Aider supports connecting to almost any LLM, Aider supports connecting to almost any LLM,
@ -25,6 +26,7 @@ So you should expect that models which are less capable than GPT-3.5 may struggl
- [Llama3](#groq) - [Llama3](#groq)
- [Cohere](#cohere) - [Cohere](#cohere)
- [Azure](#azure) - [Azure](#azure)
- [OpenRouter](#openrouter)
- [OpenAI compatible APIs](#openai-compatible-apis) - [OpenAI compatible APIs](#openai-compatible-apis)
- [Other LLMs](#other-llms) - [Other LLMs](#other-llms)
- [Editing format](#editing-format) - [Editing format](#editing-format)
@ -118,6 +120,20 @@ export AZURE_API_BASE=https://example-endpoint.openai.azure.com
aider --model azure/<your_deployment_name> aider --model azure/<your_deployment_name>
``` ```
## OpenRouter
Aider can connect to models provided by OpenRouter:
```
export OPENROUTER_API_KEY=<your-key-goes-here>
# Llama3 70B instruct
aider --model openrouter/meta-llama/llama-3-70b-instruct
# Or any other open router model
aider --model openrouter/<provider>/<model>
```
## OpenAI compatible APIs ## OpenAI compatible APIs
If your LLM is accessible via an OpenAI compatible API endpoint, If your LLM is accessible via an OpenAI compatible API endpoint,
@ -129,6 +145,7 @@ For unknown models, aider won't have normal metadata available like
the context window size, token costs, etc. the context window size, token costs, etc.
Some minor functionality will be limited when using such models. Some minor functionality will be limited when using such models.
## Other LLMs ## Other LLMs
Aider uses the [litellm](https://docs.litellm.ai/docs/providers) package Aider uses the [litellm](https://docs.litellm.ai/docs/providers) package