added refs

This commit is contained in:
Paul Gauthier 2024-05-24 15:21:57 -07:00
parent c86e258551
commit 0f84265257

View file

@ -395,3 +395,14 @@ Also thanks to Albert Örwall who has
making it faster, easier, and more reliable to run the acceptance tests.
## References
Below are the references for the SWE-Bench Lite results
displayed in the graph at the top of this page.
- 22.3% AutoCodeRover https://github.com/nus-apr/auto-code-rover
- 21.0% OpenDevin https://github.com/OpenDevin/OpenDevin
- 20.3% Amazon Q Developer Agent (v20240430-dev) https://www.swebench.com
- 18.0% SWE-Agent + GPT-4 https://www.swebench.com
- 11.7% SWE-Agent + Opus https://www.swebench.com