docs: Clarify Aider's LLM evaluation criteria and add polyglot link

This commit is contained in:
Paul Gauthier 2025-04-13 09:47:32 -07:00 committed by Paul Gauthier (aider)
parent 97b18797a4
commit 8cffb975d9

View file

@ -8,16 +8,14 @@ has_children: true
# Aider LLM Leaderboards # Aider LLM Leaderboards
Aider excels with LLMs skilled at *editing* code, not just writing it. Aider excels with LLMs skilled at writing and *editing* code,
These benchmarks evaluate an LLM's ability to follow instructions and edit code successfully without and uses benchmarks to
evaluate an LLM's ability to follow instructions and edit code successfully without
human intervention. human intervention.
Aider works best with high-scoring models, though it [can connect to almost any LLM](/docs/llms.html). [Aider's polyglot benchmark](https://aider.chat/2024/12/21/polyglot.html#the-polyglot-benchmark) tests LLMs on 225 challenging Exercism coding exercises across C++, Go, Java, JavaScript, Python, and Rust.
## Aider polyglot coding leaderboard ## Aider polyglot coding leaderboard
[Aider's polyglot benchmark](https://aider.chat/2024/12/21/polyglot.html#the-polyglot-benchmark) tests LLMs on 225 challenging Exercism coding exercises across C++, Go, Java, JavaScript, Python, and Rust.
<div id="controls-container" style="display: flex; align-items: center; max-width: 800px; margin: 10px auto; gap: 10px;"> <div id="controls-container" style="display: flex; align-items: center; max-width: 800px; margin: 10px auto; gap: 10px;">
<input type="text" id="editSearchInput" placeholder="Search..." style="flex-grow: 1; padding: 8px; border: 1px solid #ddd; border-radius: 4px;"> <input type="text" id="editSearchInput" placeholder="Search..." style="flex-grow: 1; padding: 8px; border: 1px solid #ddd; border-radius: 4px;">
<div id="view-mode-toggle" style="display: inline-flex; border: 1px solid #ccc; border-radius: 4px;"> <div id="view-mode-toggle" style="display: inline-flex; border: 1px solid #ccc; border-radius: 4px;">