dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-06-01 02:05:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 9

copy

Browse source
This commit is contained in:
Paul Gauthier 2024-05-03 15:08:38 -07:00
parent cb42150bba
commit b476671399
2 changed files with 5 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

7
_data/leaderboard.csv
View file

@ -1,6 +1,9 @@
model,second,first,format,command,version,commit,date model,second,first,format,command,version,commit,date
gpt-4-turbo-2024-04-09,64.4,49.2,diff,aider --gpt-4-turbo,0.30.1,e610e5b,5/1/24
claude-3-opus-20240229,68.4,53.4,diff,aider --opus,0.30.1,f4b1797,5/2/24 claude-3-opus-20240229,68.4,53.4,diff,aider --opus,0.30.1,f4b1797,5/2/24
gpt-4-0613,67.7,46.6,diff,aider -4,0.18.1,3aa17c4,12/16/23
gpt-4-turbo-2024-04-09,64.4,49.2,diff,aider --gpt-4-turbo,0.30.1,e610e5b,5/1/24
gemini-1.5-pro-latest,57.1,45.9,diff-fenced,aider --model gemini/gemini-1.5-pro-latest,0.32.0,5d32dd7,5/3/24 gemini-1.5-pro-latest,57.1,45.9,diff-fenced,aider --model gemini/gemini-1.5-pro-latest,0.32.0,5d32dd7,5/3/24
claude-3-sonnet-20240229,54.9,43.6,whole,aider --sonnet,0.25.0,a5f8076,3/6/24 claude-3-sonnet-20240229,54.9,43.6,whole,aider --sonnet,0.25.0,a5f8076,3/6/24
gpt-3.5-turbo-0125,49.6,39.8,whole,aider --35turbo,0.22.0,da14474,2/2/24 Deepseek Coder,54.5,47,whole,aider --model openai/deepseek-coder,0.30.1,c07f793,4/29/24
gpt-3.5-turbo-0125,49.6,39.8,whole,aider --35turbo,0.22.0,da14474,2/2/24
Command-R+,29.3,22.6,whole,aider --model command-r-plus,0.28.0,a06c927,4/20/24
1 model second first format command version commit date
gpt-4-turbo-2024-04-09 64.4 49.2 diff aider --gpt-4-turbo 0.30.1 e610e5b 5/1/24
2 claude-3-opus-20240229 68.4 53.4 diff aider --opus 0.30.1 f4b1797 5/2/24
3 gpt-4-0613 67.7 46.6 diff aider -4 0.18.1 3aa17c4 12/16/23
4 gpt-4-turbo-2024-04-09 64.4 49.2 diff aider --gpt-4-turbo 0.30.1 e610e5b 5/1/24
5 gemini-1.5-pro-latest 57.1 45.9 diff-fenced aider --model gemini/gemini-1.5-pro-latest 0.32.0 5d32dd7 5/3/24
6 claude-3-sonnet-20240229 54.9 43.6 whole aider --sonnet 0.25.0 a5f8076 3/6/24
7 gpt-3.5-turbo-0125 Deepseek Coder 49.6 54.5 39.8 47 whole aider --35turbo aider --model openai/deepseek-coder 0.22.0 0.30.1 da14474 c07f793 2/2/24 4/29/24
8 gpt-3.5-turbo-0125 49.6 39.8 whole aider --35turbo 0.22.0 da14474 2/2/24
9 Command-R+ 29.3 22.6 whole aider --model command-r-plus 0.28.0 a06c927 4/20/24

3
docs/leaderboard.md
View file

@ -22,9 +22,6 @@
<td>{{ row.first }}</td> <td>{{ row.first }}</td>
<td>{{ row.format }}</td> <td>{{ row.format }}</td>
<td>{{ row.command }}</td> <td>{{ row.command }}</td>
<td>{{ row.version }}</td>
<td>{{ row.commit }}</td>
<td>{{ row.date }}</td>
</tr> </tr>
{% endfor %} {% endfor %}
</tbody> </tbody>