This commit is contained in:
Paul Gauthier 2024-05-31 09:28:42 -07:00
parent c76215f302
commit 5e9bf8993d

View file

@ -415,12 +415,12 @@ displayed in the graph at the beginning of this article.
Note, the graph was corrected on 5/30/24 as follows. Note, the graph was corrected on 5/30/24 as follows.
The graph now contains AutoCodeRover's pass@1 results. The graph now contains AutoCodeRover's average pass@1 results.
Previously it displayed the pass@3 results, which are Previously it displayed pass@3 results, which are
not comparable not comparable
to the pass@1 results for aider being reported here. to the pass@1 results for aider being reported here.
The [AutoCodeRover GitHub page](https://github.com/nus-apr/auto-code-rover) The [AutoCodeRover GitHub page](https://github.com/nus-apr/auto-code-rover)
features the pass@3 results features pass@3 results
without being clearly labeled. without being clearly labeled.
The graph now contains the best OpenDevin results obtained without using The graph now contains the best OpenDevin results obtained without using