dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-29 00:35:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4

added leaderboard

Browse source
This commit is contained in:
Paul Gauthier 2024-05-03 14:52:21 -07:00
parent 4825808f85
commit cb42150bba
2 changed files with 10 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

6
_data/leaderboard.csv Normal file
View file

@ -0,0 +1,6 @@
model,second,first,format,command,version,commit,date
gpt-4-turbo-2024-04-09,64.4,49.2,diff,aider --gpt-4-turbo,0.30.1,e610e5b,5/1/24
claude-3-opus-20240229,68.4,53.4,diff,aider --opus,0.30.1,f4b1797,5/2/24
gemini-1.5-pro-latest,57.1,45.9,diff-fenced,aider --model gemini/gemini-1.5-pro-latest,0.32.0,5d32dd7,5/3/24
claude-3-sonnet-20240229,54.9,43.6,whole,aider --sonnet,0.25.0,a5f8076,3/6/24
gpt-3.5-turbo-0125,49.6,39.8,whole,aider --35turbo,0.22.0,da14474,2/2/24
1 model second first format command version commit date
2 gpt-4-turbo-2024-04-09 64.4 49.2 diff aider --gpt-4-turbo 0.30.1 e610e5b 5/1/24
3 claude-3-opus-20240229 68.4 53.4 diff aider --opus 0.30.1 f4b1797 5/2/24
4 gemini-1.5-pro-latest 57.1 45.9 diff-fenced aider --model gemini/gemini-1.5-pro-latest 0.32.0 5d32dd7 5/3/24
5 claude-3-sonnet-20240229 54.9 43.6 whole aider --sonnet 0.25.0 a5f8076 3/6/24
6 gpt-3.5-turbo-0125 49.6 39.8 whole aider --35turbo 0.22.0 da14474 2/2/24

8
docs/leaderboard.md
View file

@ -5,12 +5,12 @@
<thead>
<tr>
<th>Model</th>
<th>Second</th>
<th>First</th>
<th>Format</th>
<th>Final score</th>
<th>First try score</th>
<th>Edit format</th>
<th>Command</th>
<th>Version</th>
<th>Commit</th>
<th>Git commit</th>
<th>Date</th>
</tr>
</thead>