dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-31 01:35:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 9

Update leaderboard.csv

Browse source
This commit is contained in:
paul-gauthier 2024-05-03 20:29:29 -07:00 • committed by GitHub
parent a496abbfa4
commit d8a18f2c67
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
_data/leaderboard.csv
View file

@ -1,7 +1,7 @@
model,second,first,format,command,version,commit,date
claude-3-opus-20240229,68.4,53.4,diff,aider --opus,0.30.1,f4b1797,5/2/24
gpt-4-0613,67.7,46.6,diff,aider -4,0.18.1,3aa17c4,12/16/23
gpt-4-turbo-2024-04-09,64.4,49.2,diff,aider --gpt-4-turbo,0.30.1,e610e5b,5/1/24
gpt-4-turbo-2024-04-09,64.4,49.2,udiff,aider --gpt-4-turbo,0.30.1,e610e5b,5/1/24
gemini-1.5-pro-latest,57.1,45.9,diff-fenced,aider --model gemini/gemini-1.5-pro-latest,0.32.0,5d32dd7,5/3/24
gpt-3.5-turbo-1106,56.1,45.5,whole,aider --model gpt-3.5-turbo-1106,0.30.1,7b14d77,4/30/24
claude-3-sonnet-20240229,54.9,43.6,whole,aider --sonnet,0.25.0,a5f8076,3/6/24

1 model second first format command version commit date
2 claude-3-opus-20240229 68.4 53.4 diff aider --opus 0.30.1 f4b1797 5/2/24
3 gpt-4-0613 67.7 46.6 diff aider -4 0.18.1 3aa17c4 12/16/23
4 gpt-4-turbo-2024-04-09 64.4 49.2 diff udiff aider --gpt-4-turbo 0.30.1 e610e5b 5/1/24
5 gemini-1.5-pro-latest 57.1 45.9 diff-fenced aider --model gemini/gemini-1.5-pro-latest 0.32.0 5d32dd7 5/3/24
6 gpt-3.5-turbo-1106 56.1 45.5 whole aider --model gpt-3.5-turbo-1106 0.30.1 7b14d77 4/30/24
7 claude-3-sonnet-20240229 54.9 43.6 whole aider --sonnet 0.25.0 a5f8076 3/6/24