aider/website/docs/llms/warnings.md
Paul Gauthier 8e036fa891 copy
2024-06-11 13:32:08 -07:00

1.1 KiB

parent nav_order
Connecting to LLMs 900

Model warnings

{% include model-warnings.md %}

Specifying context window size and token costs

You can register context window limits and costs for models that aren't known to aider. Create a .aider.models.json file in one of these locations:

  • Your home directory.
  • The root if your git repo.
  • The current directory where you launch aider.
  • Or specify a specific file with the --model-metadata-file <filename> switch.

If the files above exist, they will be loaded in that order. Files loaded last will take priority.

The json file should be a dictionary with an entry for each model, as follows:

{
    "deepseek-chat": {
        "max_tokens": 4096,
        "max_input_tokens": 32000,
        "max_output_tokens": 4096,
        "input_cost_per_token": 0.00000014,
        "output_cost_per_token": 0.00000028,
        "litellm_provider": "deepseek",
        "mode": "chat"
    }
}

See litellm's model_prices_and_context_window.json file for more examples.