updated autocoderover results

This commit is contained in:
Paul Gauthier 2024-05-30 09:45:02 -07:00
parent b8b207f4de
commit d5ca9b3696
4 changed files with 248 additions and 215 deletions

View file

@ -400,8 +400,9 @@ Below are the references for the SWE-Bench Lite results
displayed in the graph at the top of this page.
- [25.0% OpenDevin](https://x.com/gneubig/status/1791498953709752405)
- [22.3% AutoCodeRover](https://github.com/nus-apr/auto-code-rover)
- [19.0% AutoCodeRover](https://github.com/swe-bench/experiments/pull/11)
- [20.3% Amazon Q Developer Agent (v20240430-dev)](https://www.swebench.com)
- [18.0% SWE-Agent + GPT-4](https://www.swebench.com)
- [11.7% SWE-Agent + Opus](https://www.swebench.com)
Note: Graph updated on 5/30/24 to accurately reflect AutoCodeRover's pass@1 results.