From 8aa1e10f2a1e0a3ac4bff50f911f19fb8bb1a4f3 Mon Sep 17 00:00:00 2001 From: Paul Gauthier Date: Fri, 3 May 2024 17:14:56 -0700 Subject: [PATCH] copy --- docs/leaderboard.md | 8 ++++++++ docs/llms.md | 4 ++++ 2 files changed, 12 insertions(+) diff --git a/docs/leaderboard.md b/docs/leaderboard.md index 15efcbf01..ad7710336 100644 --- a/docs/leaderboard.md +++ b/docs/leaderboard.md @@ -62,3 +62,11 @@ context window sizes. All of the other diff-like edit formats are much more efficient with their use of tokens. +## Contributing benchmark results + +Contributions of benchmark results are welcome! +See the +[benchmark README]() +for information on running aider's code editing benchmark. +Submit results by opening a PR with edits to the +[benchmark results CSV data file](https://github.com/paul-gauthier/aider/blob/main/_data/leaderboard.csv). \ No newline at end of file diff --git a/docs/llms.md b/docs/llms.md index ec5420191..99c39019c 100644 --- a/docs/llms.md +++ b/docs/llms.md @@ -27,6 +27,10 @@ local models that provide an ## Use a capable model +Check +[Aider's LLM leaderboard](https://aider.chat/docs/leaderboard.html) +to see which models work best with aider. + Be aware that aider may not work well with less capable models. If you see the model returning code, but aider isn't able to edit your files and commit the changes...