diff --git a/docs/llms.md b/docs/llms.md index 601944f94..d1131b217 100644 --- a/docs/llms.md +++ b/docs/llms.md @@ -68,7 +68,9 @@ has been tested and benchmarked to work well with them: ``` pip install aider-chat -export OPENAI_API_KEY= # Windows: setx OPENAI_API_KEY + +export OPENAI_API_KEY= # Linux/Mac +setx OPENAI_API_KEY # Windows # GPT-4 Turbo is used by default aider @@ -99,7 +101,7 @@ has been tested and benchmarked to work well with them: ``` pip install aider-chat -export ANTHROPIC_API_KEY= # Windows: setx ANTHROPIC_API_KEY +export ANTHROPIC_API_KEY= # Windows: setx ANTHROPIC_API_KEY # Claude 3 Opus aider --opus @@ -125,7 +127,7 @@ You'll need a [Gemini API key](https://aistudio.google.com/app/u/2/apikey). ``` pip install aider-chat -export GEMINI_API_KEY= # Windows: setx GEMINI_API_KEY +export GEMINI_API_KEY= # Windows: setx GEMINI_API_KEY aider --model gemini/gemini-1.5-pro-latest # List models available from Gemini @@ -143,7 +145,7 @@ To use **Llama3 70B**: ``` pip install aider-chat -export GROQ_API_KEY= # Windows: setx GROQ_API_KEY +export GROQ_API_KEY= # Windows: setx GROQ_API_KEY aider --model groq/llama3-70b-8192 # List models available from Groq @@ -162,7 +164,7 @@ To use **Command-R+**: ``` pip install aider-chat -export COHERE_API_KEY= # Windows: setx COHERE_API_KEY +export COHERE_API_KEY= # Windows: setx COHERE_API_KEY aider --model command-r-plus # List models available from Cohere @@ -175,9 +177,12 @@ Aider can connect to the OpenAI models on Azure. ``` pip install aider-chat -export AZURE_API_KEY= # Windows: setx AZURE_API_KEY -export AZURE_API_VERSION=2023-05-15 # Windows: setx AZURE_API_VERSION 2023-05-15 -export AZURE_API_BASE=https://example-endpoint.openai.azure.com # Windows: setx AZURE_API_BASE https://example-endpoint.openai.azure.com + +# Linux/Mac: # Windows: +export AZURE_API_KEY= # setx AZURE_API_KEY +export AZURE_API_VERSION=2023-05-15 # setx AZURE_API_VERSION 2023-05-15 +export AZURE_API_BASE=https://myendpt.openai.azure.com # setx AZURE_API_BASE https://myendpt.openai.azure.com + aider --model azure/ # List models available from Azure @@ -191,7 +196,7 @@ You'll need an [OpenRouter API key](https://openrouter.ai/keys). ``` pip install aider-chat -export OPENROUTER_API_KEY= # Windows: setx OPENROUTER_API_KEY +export OPENROUTER_API_KEY= # Windows: setx OPENROUTER_API_KEY # Or any other open router model aider --model openrouter// @@ -204,7 +209,7 @@ In particular, Llama3 70B works well with aider, at low cost: ``` pip install aider-chat -export OPENROUTER_API_KEY= +export OPENROUTER_API_KEY= aider --model openrouter/meta-llama/llama-3-70b-instruct ``` @@ -215,7 +220,7 @@ Aider can connect to local Ollama models. ``` # Pull the model -ollama pull +ollama pull # Start your ollama server ollama serve @@ -223,7 +228,7 @@ ollama serve # In another terminal window pip install aider-chat export OLLAMA_API_BASE=http://127.0.0.1:11434 # Windows: setx OLLAMA_API_BASE http://127.0.0.1:11434 -aider --model ollama/ +aider --model ollama/ ``` In particular, `llama3:70b` works very well with aider: @@ -234,7 +239,7 @@ ollama pull llama3:70b ollama serve # ...in another terminal window... -export OLLAMA_API_BASE=http://127.0.0.1:11434 +export OLLAMA_API_BASE=http://127.0.0.1:11434 # Windows: setx OLLAMA_API_BASE http://127.0.0.1:11434 aider --model ollama/llama3:70b ``` @@ -250,8 +255,11 @@ They appear to grant 5M tokens of free API usage to new accounts. ``` pip install aider-chat -export OPENAI_API_KEY= # Windows: setx OPENAI_API_KEY -export OPENAI_API_BASE=https://api.deepseek.com/v1 # Windows: setx OPENAI_API_BASE https://api.deepseek.com/v1 + +# Linux/Mac: # Windows: +export OPENAI_API_KEY= # setx OPENAI_API_KEY +export OPENAI_API_BASE=https://api.deepseek.com/v1 # setx OPENAI_API_BASE https://api.deepseek.com/v1 + aider --model openai/deepseek-coder ``` @@ -266,10 +274,10 @@ Aider can connect to any LLM which is accessible via an OpenAI compatible API en ``` pip install aider-chat -export OPENAI_API_BASE= # Windows: setx OPENAI_API_BASE -# If your endpoint needs a key -export OPENAI_API_KEY= # Windows: setx OPENAI_API_KEY +# Linux/Mac: # Windows: +export OPENAI_API_BASE= # setx OPENAI_API_BASE +export OPENAI_API_KEY= # setx OPENAI_API_KEY # Prefix the model name with openai/ aider --model openai/ @@ -396,12 +404,12 @@ models you use with aider. Here is an example `.env` file: ``` -OPENAI_API_KEY= -ANTHROPIC_API_KEY= -GROQ_API_KEY= -OPENROUTER_API_KEY= +OPENAI_API_KEY= +ANTHROPIC_API_KEY= +GROQ_API_KEY= +OPENROUTER_API_KEY= -AZURE_API_KEY= +AZURE_API_KEY= AZURE_API_VERSION=2023-05-15 AZURE_API_BASE=https://example-endpoint.openai.azure.com