From a57f81ba5f24ead33160d0a5bd9ab4c24787fbb7 Mon Sep 17 00:00:00 2001 From: Paul Gauthier Date: Sat, 23 Nov 2024 07:02:58 -0800 Subject: [PATCH] copy --- aider/website/docs/config/adv-model-settings.md | 7 +++++++ aider/website/docs/troubleshooting/token-limits.md | 7 +++++++ 2 files changed, 14 insertions(+) diff --git a/aider/website/docs/config/adv-model-settings.md b/aider/website/docs/config/adv-model-settings.md index fdb6b9c55..31b2c21cc 100644 --- a/aider/website/docs/config/adv-model-settings.md +++ b/aider/website/docs/config/adv-model-settings.md @@ -11,6 +11,13 @@ description: Configuring advanced settings for LLMs. In most cases, you can safely ignore aider's warning about unknown context window size and model costs. +{: .note } +Aider never *enforces* token limits, it only *reports* token limit errors +from the API provider. +You probably don't need to +configure aider with the proper token limits +for unusual models. + But, you can register context window limits and costs for models that aren't known to aider. Create a `.aider.model.metadata.json` file in one of these locations: diff --git a/aider/website/docs/troubleshooting/token-limits.md b/aider/website/docs/troubleshooting/token-limits.md index 3e42f1a92..a3812475c 100644 --- a/aider/website/docs/troubleshooting/token-limits.md +++ b/aider/website/docs/troubleshooting/token-limits.md @@ -33,6 +33,13 @@ To reduce output tokens: For more info: https://aider.chat/docs/token-limits.html ``` +{: .note } +Aider never *enforces* token limits, it only *reports* token limit errors +from the API provider. +You probably don't need to +[configure aider with the proper token limits](http://0.0.0.0:4000/docs/config/adv-model-settings.html#context-window-size-and-token-costs) +for unusual models. + ## Input tokens & context window size The most common problem is trying to send too much data to a