From bbd81c3cf7d53e2bd3cc257552f89aad970168d2 Mon Sep 17 00:00:00 2001 From: Paul Gauthier Date: Tue, 26 Nov 2024 06:56:36 -0800 Subject: [PATCH] copy --- aider/website/docs/troubleshooting/edit-errors.md | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/aider/website/docs/troubleshooting/edit-errors.md b/aider/website/docs/troubleshooting/edit-errors.md index 6bd693627..7aab589b1 100644 --- a/aider/website/docs/troubleshooting/edit-errors.md +++ b/aider/website/docs/troubleshooting/edit-errors.md @@ -42,14 +42,16 @@ disobeying the system prompt instructions. Most local models are just barely capable of working with aider, so editing errors are probably unavoidable. -Local models which have been quantized are even more likely to have problems -because they are not capable enough to follow aider's system prompts. +## Local models: context window and quantization Be especially careful about the [Ollama context window](https://aider.chat/docs/llms/ollama.html#setting-the-context-window-size) when working with local models. It defaults to be very small and silently discards data if you exceed it. +Local models which have been quantized are more likely to have editing problems +because they are not capable enough to follow aider's system prompts. + ## Try the whole edit format Run aider with `--edit-format whole` if were using a different edit format.