This commit is contained in:
Paul Gauthier 2024-11-26 06:56:36 -08:00
parent 301eb7c74d
commit bbd81c3cf7

View file

@ -42,14 +42,16 @@ disobeying the system prompt instructions.
Most local models are just barely capable of working with aider,
so editing errors are probably unavoidable.
Local models which have been quantized are even more likely to have problems
because they are not capable enough to follow aider's system prompts.
## Local models: context window and quantization
Be especially careful about the
[Ollama context window](https://aider.chat/docs/llms/ollama.html#setting-the-context-window-size)
when working with local models.
It defaults to be very small and silently discards data if you exceed it.
Local models which have been quantized are more likely to have editing problems
because they are not capable enough to follow aider's system prompts.
## Try the whole edit format
Run aider with `--edit-format whole` if were using a different edit format.