This commit is contained in:
Paul Gauthier 2024-11-26 06:56:36 -08:00
parent 301eb7c74d
commit bbd81c3cf7

View file

@ -42,14 +42,16 @@ disobeying the system prompt instructions.
Most local models are just barely capable of working with aider, Most local models are just barely capable of working with aider,
so editing errors are probably unavoidable. so editing errors are probably unavoidable.
Local models which have been quantized are even more likely to have problems ## Local models: context window and quantization
because they are not capable enough to follow aider's system prompts.
Be especially careful about the Be especially careful about the
[Ollama context window](https://aider.chat/docs/llms/ollama.html#setting-the-context-window-size) [Ollama context window](https://aider.chat/docs/llms/ollama.html#setting-the-context-window-size)
when working with local models. when working with local models.
It defaults to be very small and silently discards data if you exceed it. It defaults to be very small and silently discards data if you exceed it.
Local models which have been quantized are more likely to have editing problems
because they are not capable enough to follow aider's system prompts.
## Try the whole edit format ## Try the whole edit format
Run aider with `--edit-format whole` if were using a different edit format. Run aider with `--edit-format whole` if were using a different edit format.