dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-06-03 03:05:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4

copy

Browse source
This commit is contained in:
Paul Gauthier 2024-10-04 12:56:19 -07:00
parent 516e637c39
commit 1c67ddcbff
5 changed files with 16 additions and 16 deletions
Download patch file Download diff file Expand all files Collapse all files

4
benchmark/README.md
View file

@ -138,13 +138,13 @@ This way the `model`, `edit_format` and `commit_hash`
should be enough to reliably reproduce any benchmark run.
You can see examples of the benchmark report yaml in the
[aider leaderboard data files](https://github.com/paul-gauthier/aider/blob/main/aider/website/_data/).
[aider leaderboard data files](https://github.com/Aider-AI/aider/blob/main/aider/website/_data/).
## Limitations, notes
- Benchmarking all 133 exercises against Claude 3.5 Sonnet will cost about $4.
- Contributions of benchmark results are welcome! Submit results by opening a PR with edits to the
[aider leaderboard data files](https://github.com/paul-gauthier/aider/blob/main/aider/website/_data/).
[aider leaderboard data files](https://github.com/Aider-AI/aider/blob/main/aider/website/_data/).
- These scripts are not intended for use by typical aider end users.
- Some of these tools are written as `bash` scripts, so it will be hard to use them on Windows.