From ab1d3502fc0dc92dae0a4ff4e7fa80fa4ff6b9b6 Mon Sep 17 00:00:00 2001 From: Paul Gauthier Date: Fri, 26 Jul 2024 15:00:17 +0200 Subject: [PATCH] copy --- aider/website/docs/leaderboards/index.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/aider/website/docs/leaderboards/index.md b/aider/website/docs/leaderboards/index.md index ad9359198..451807eb7 100644 --- a/aider/website/docs/leaderboards/index.md +++ b/aider/website/docs/leaderboards/index.md @@ -25,7 +25,10 @@ results and additional information: ## Code editing leaderboard [Aider's code editing benchmark](/docs/benchmarks.html#the-benchmark) asks the LLM to edit python source files to complete 133 small coding exercises -from Exercism. This benchmark measures the LLM's coding ability, but also whether it can consistently emit code edits in the format specified in the system prompt. +from Exercism. +This measures the LLM's coding ability, and whether it can +write new code that integrates into existing code. +The model also has to successfully apply all its changes to the source file without human intervention.