This commit is contained in:
Paul Gauthier 2024-11-14 15:15:23 -08:00
parent 66f94d2141
commit 6b792de802

View file

@ -19,7 +19,19 @@ LLM edits that are "almost" correctly formatted.
But sometimes the LLM just won't cooperate. But sometimes the LLM just won't cooperate.
In these cases, here are some things you might try. In these cases, here are some things you might try.
## Use a capable model ## Don't add too many files
Many LLMs now have very large context windows,
but filling them with irrelevant code or conversation
can confuse the model.
- Don't add too many files to the chat, *just* add the files you think need to be edited.
Aider also sends the LLM a [map of your entire git repo](https://aider.chat/docs/repomap.html), so other relevant code will be included automatically.
- Use `/drop` to remove files from the chat session which aren't needed for the task at hand. This will reduce distractions and may help the LLM produce properly formatted edits.
- Use `/clear` to remove the conversation history, again to help the LLM focus.
- Use `/tokens` to see how many tokens you are using for each message.
## Use a more capable model
If possible try using GPT-4o, Claude 3.5 Sonnet or Claude 3 Opus, If possible try using GPT-4o, Claude 3.5 Sonnet or Claude 3 Opus,
as they are the strongest and most capable models. as they are the strongest and most capable models.
@ -33,9 +45,9 @@ so editing errors are probably unavoidable.
Local models which have been quantized are even more likely to have problems Local models which have been quantized are even more likely to have problems
because they are not capable enough to follow aider's system prompts. because they are not capable enough to follow aider's system prompts.
## Try the whole format ## Try the whole edit format
Run aider with `--edit-format whole` if the model is using a different edit format. Run aider with `--edit-format whole` if were using a different edit format.
You can see which edit format it is using in the announce lines: You can see which edit format it is using in the announce lines:
``` ```
@ -43,17 +55,6 @@ Aider v0.50.2-dev
Models: claude-3-5-sonnet-20240620 with ♾️ diff edit format Models: claude-3-5-sonnet-20240620 with ♾️ diff edit format
``` ```
## Reduce distractions
Many LLMs now have very large context windows,
but filling them with irrelevant code or conversation
can confuse the model.
- Don't add too many files to the chat, *just* add the files you think need to be edited.
Aider also sends the LLM a [map of your entire git repo](https://aider.chat/docs/repomap.html), so other relevant code will be included automatically.
- Use `/drop` to remove files from the chat session which aren't needed for the task at hand. This will reduce distractions and may help the LLM produce properly formatted edits.
- Use `/clear` to remove the conversation history, again to help the LLM focus.
- Use `/tokens` to see how many tokens you are using for each message.
## More help ## More help