From 07731e30dc336dbb4ac558b742d1c45766476505 Mon Sep 17 00:00:00 2001 From: Paul Gauthier Date: Thu, 30 May 2024 09:52:47 -0700 Subject: [PATCH] copy --- _posts/2024-05-22-swe-bench-lite.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/_posts/2024-05-22-swe-bench-lite.md b/_posts/2024-05-22-swe-bench-lite.md index cb89283fa..44260d3ed 100644 --- a/_posts/2024-05-22-swe-bench-lite.md +++ b/_posts/2024-05-22-swe-bench-lite.md @@ -405,4 +405,6 @@ displayed in the graph at the top of this page. - [18.0% SWE-Agent + GPT-4](https://www.swebench.com) - [11.7% SWE-Agent + Opus](https://www.swebench.com) -Note: Graph updated on 5/30/24 to accurately reflect AutoCodeRover's pass@1 results. \ No newline at end of file +Note: Graph updated on 5/30/24 to accurately reflect AutoCodeRover's pass@1 results. +The previous graph contained their pass@3 result, which is not comparable +to the aider results being reported here.