aider/benchmark/swe-bench.txt
Paul Gauthier 47a3cb8adf copy
2024-06-01 15:05:29 -07:00

7 lines
205 B
Text

18.9% Aider|GPT-4o|& Opus|(570)
17.0% Aider|GPT-4o|(570)
13.9% Devin|(570)
13.8% Amazon Q|Developer|Agent|(2294)
12.5% SWE-|Agent|+ GPT-4|(2294)
10.6% Auto|Code|Rover|(2294)
10.5% SWE-|Agent|+ Opus|(2294)