mirror of
https://github.com/Aider-AI/aider.git
synced 2025-05-25 14:55:00 +00:00
copy
This commit is contained in:
parent
301eb7c74d
commit
bbd81c3cf7
1 changed files with 4 additions and 2 deletions
|
@ -42,14 +42,16 @@ disobeying the system prompt instructions.
|
||||||
Most local models are just barely capable of working with aider,
|
Most local models are just barely capable of working with aider,
|
||||||
so editing errors are probably unavoidable.
|
so editing errors are probably unavoidable.
|
||||||
|
|
||||||
Local models which have been quantized are even more likely to have problems
|
## Local models: context window and quantization
|
||||||
because they are not capable enough to follow aider's system prompts.
|
|
||||||
|
|
||||||
Be especially careful about the
|
Be especially careful about the
|
||||||
[Ollama context window](https://aider.chat/docs/llms/ollama.html#setting-the-context-window-size)
|
[Ollama context window](https://aider.chat/docs/llms/ollama.html#setting-the-context-window-size)
|
||||||
when working with local models.
|
when working with local models.
|
||||||
It defaults to be very small and silently discards data if you exceed it.
|
It defaults to be very small and silently discards data if you exceed it.
|
||||||
|
|
||||||
|
Local models which have been quantized are more likely to have editing problems
|
||||||
|
because they are not capable enough to follow aider's system prompts.
|
||||||
|
|
||||||
## Try the whole edit format
|
## Try the whole edit format
|
||||||
|
|
||||||
Run aider with `--edit-format whole` if were using a different edit format.
|
Run aider with `--edit-format whole` if were using a different edit format.
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue