This commit is contained in:
Paul Gauthier 2024-06-03 12:21:09 -07:00
parent 5d08c69ba0
commit 8a95ce80ae
2 changed files with 0 additions and 10 deletions

View file

@ -446,8 +446,3 @@ which is not comparable
to the unhinted aider results being reported here.
[OpenDevin reported hinted results](https://x.com/gneubig/status/1791498953709752405)
without noting that hints were used.
The [official SWE Bench Lite leaderboard](https://www.swebench.com)
only accepts pass@1 results that do not use `hints_text`.