aider/benchmark/swe-bench-lite.txt
Paul Gauthier 689786a875 copy
2024-05-25 12:14:48 -07:00

7 lines
163 B
Text

26.3% Aider|GPT-4o|& Opus
25.0% Aider|GPT-4o
25.0% Open|Devin
22.3% AutoCode|Rover
20.3% Amazon Q|Developer|Agent
18.0% SWE-|Agent|+ GPT-4
11.7% SWE-|Agent|+ Opus