aider/benchmark/swe-bench.txt
Paul Gauthier 6a2d7e08c2 copy
2024-05-31 13:32:20 -07:00

7 lines
205 B
Text

18.8% Aider|GPT-4o|& Opus|(570)
17.0% Aider|GPT-4o|(570)
13.9% Devin|(570)
13.8% Amazon Q|Developer|Agent|(2294)
12.5% SWE-|Agent|+ GPT-4|(2294)
10.6% Auto|Code|Rover|(2294)
10.5% SWE-|Agent|+ Opus|(2294)