mirror of
https://github.com/Aider-AI/aider.git
synced 2025-05-29 08:44:59 +00:00
copy
This commit is contained in:
parent
1ea2b56356
commit
f1ce673f78
1 changed files with 18 additions and 1 deletions
19
docs/llms.md
19
docs/llms.md
|
@ -9,7 +9,8 @@ Aider also works quite well with [GPT-3.5](#openai).
|
||||||
|
|
||||||
To use aider with a *free* API provider, you can use [Groq's Llama 3 70B](#llama3)
|
To use aider with a *free* API provider, you can use [Groq's Llama 3 70B](#llama3)
|
||||||
which is comparable to GPT-3.5 in code editing performance.
|
which is comparable to GPT-3.5 in code editing performance.
|
||||||
Cohere also offers free API access to their [Command-R+ model](#cohere), which works with aider
|
Cohere also offers free API access to their [Command-R+ model](#cohere),
|
||||||
|
which works with aider
|
||||||
as a *very basic* coding assistant.
|
as a *very basic* coding assistant.
|
||||||
|
|
||||||
Aider supports connecting to almost any LLM,
|
Aider supports connecting to almost any LLM,
|
||||||
|
@ -25,6 +26,7 @@ So you should expect that models which are less capable than GPT-3.5 may struggl
|
||||||
- [Llama3](#groq)
|
- [Llama3](#groq)
|
||||||
- [Cohere](#cohere)
|
- [Cohere](#cohere)
|
||||||
- [Azure](#azure)
|
- [Azure](#azure)
|
||||||
|
- [OpenRouter](#openrouter)
|
||||||
- [OpenAI compatible APIs](#openai-compatible-apis)
|
- [OpenAI compatible APIs](#openai-compatible-apis)
|
||||||
- [Other LLMs](#other-llms)
|
- [Other LLMs](#other-llms)
|
||||||
- [Editing format](#editing-format)
|
- [Editing format](#editing-format)
|
||||||
|
@ -118,6 +120,20 @@ export AZURE_API_BASE=https://example-endpoint.openai.azure.com
|
||||||
aider --model azure/<your_deployment_name>
|
aider --model azure/<your_deployment_name>
|
||||||
```
|
```
|
||||||
|
|
||||||
|
## OpenRouter
|
||||||
|
|
||||||
|
Aider can connect to models provided by OpenRouter:
|
||||||
|
|
||||||
|
```
|
||||||
|
export OPENROUTER_API_KEY=<your-key-goes-here>
|
||||||
|
|
||||||
|
# Llama3 70B instruct
|
||||||
|
aider --model openrouter/meta-llama/llama-3-70b-instruct
|
||||||
|
|
||||||
|
# Or any other open router model
|
||||||
|
aider --model openrouter/<provider>/<model>
|
||||||
|
```
|
||||||
|
|
||||||
## OpenAI compatible APIs
|
## OpenAI compatible APIs
|
||||||
|
|
||||||
If your LLM is accessible via an OpenAI compatible API endpoint,
|
If your LLM is accessible via an OpenAI compatible API endpoint,
|
||||||
|
@ -129,6 +145,7 @@ For unknown models, aider won't have normal metadata available like
|
||||||
the context window size, token costs, etc.
|
the context window size, token costs, etc.
|
||||||
Some minor functionality will be limited when using such models.
|
Some minor functionality will be limited when using such models.
|
||||||
|
|
||||||
|
|
||||||
## Other LLMs
|
## Other LLMs
|
||||||
|
|
||||||
Aider uses the [litellm](https://docs.litellm.ai/docs/providers) package
|
Aider uses the [litellm](https://docs.litellm.ai/docs/providers) package
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue