This commit is contained in:
Paul Gauthier 2024-06-08 10:27:05 -07:00
parent 74e51d5c31
commit 4017c47406
3 changed files with 11 additions and 64 deletions

View file

@ -0,0 +1,8 @@
---
parent: Connecting to LLMs
nav_order: 900
---
# Model warnings
{% include model-warnings.md %}

View file

@ -25,10 +25,10 @@ If possible try using GPT-4o or Opus, as they are the strongest and most
capable models.
Weaker models
are more pront to
are more prone to
disobeying the system prompt instructions.
Most local models are just barely capable of working with aider,
so editing errors should be expected.
so editing errors are probably unavoidable.
## Reduce distractions

View file

@ -5,66 +5,5 @@ nav_order: 20
# Model warnings
Aider supports connecting to almost any LLM,
but it may not work well with less capable models.
If you see the model returning code, but aider isn't able to edit your files
and commit the changes...
this is usually because the model isn't capable of properly
returning "code edits".
Models weaker than GPT 3.5 may have problems working well with aider.
Aider tries to sanity check that it is configured correctly
to work with the specified model:
- It checks to see that all required environment variables are set for the model. These variables are required to configure things like API keys, API base URLs, etc.
- It checks a metadata database to look up the context window size and token costs for the model.
Sometimes one or both of these checks will fail, so aider will issue
some of the following warnings.
## Missing environment variables
```
Model azure/gpt-4-turbo: Missing these environment variables:
- AZURE_API_BASE
- AZURE_API_VERSION
- AZURE_API_KEY
```
You need to set the listed environment variables.
Otherwise you will get error messages when you start chatting with the model.
## Unknown which environment variables are required
```
Model gpt-5: Unknown which environment variables are required.
```
Aider is unable verify the environment because it doesn't know
which variables are required for the model.
If required variables are missing,
you may get errors when you attempt to chat with the model.
You can look in the
[litellm provider documentation](https://docs.litellm.ai/docs/providers)
to see if the required variables are listed there.
## Unknown model, did you mean?
```
Model gpt-5: Unknown model, context window size and token costs unavailable.
Did you mean one of these?
- gpt-4
```
If you specify a model that aider has never heard of, you will get an
"unknown model" warning.
This means aider doesn't know the context window size and token costs
for that model.
Some minor functionality will be limited when using such models, but
it's not really a significant problem.
Aider will also try to suggest similarly named models,
in case you made a typo or mistake when specifying the model name.
{% include model-warnings.md %}