From cb2388dc9ed3b448f445750efe142d896c4a1dc7 Mon Sep 17 00:00:00 2001 From: paul-gauthier <69695708+paul-gauthier@users.noreply.github.com> Date: Tue, 7 Nov 2023 11:33:25 -0800 Subject: [PATCH] Update benchmarks-1106.md --- docs/benchmarks-1106.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/benchmarks-1106.md b/docs/benchmarks-1106.md index cbac5fe25..ef75fb35c 100644 --- a/docs/benchmarks-1106.md +++ b/docs/benchmarks-1106.md @@ -25,7 +25,7 @@ For example, whenever I change aider's prompting or the backend which drives LLM conversations, I run the benchmark to make sure these changes produce improvements (not regressions). -The benchmark users aider to try and complete +The benchmark uses aider to try and complete [133 Exercism Python coding exercises](https://github.com/exercism/python). For each exercise, Exercism provides a starting python file with stubs for the needed functions, a natural language description of the problem to solve