dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-28 08:14:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4

copy

Browse source
This commit is contained in:
Paul Gauthier 2024-06-20 08:29:16 -07:00
parent 090e0cdcfe
commit e5e07f9507
2 changed files with 4 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

4
website/_data/edit_leaderboard.yml
View file

@ -630,7 +630,7 @@
indentation_errors: 0
exhausted_context_windows: 0
test_timeouts: 0
command: aider --model openrouter/anthropic/claude-3.5-sonnet
command: aider --model openrouter/anthropic/claude-3.5-sonnet --edit-format whole
date: 2024-06-20
versions: 0.38.1-dev
seconds_per_case: 15.4
@ -638,7 +638,7 @@
- dirname: 2024-06-20-15-16-41--claude-3.5-sonnet-diff
test_cases: 133
model: openrouter/anthropic/claude-3.5-sonnet
model: claude-3.5-sonnet (diff)
edit_format: diff
commit_hash: 068609e-dirty
pass_rate_1: 57.9

3
website/docs/leaderboards/index.md
View file

@ -19,13 +19,14 @@ it works best with models that score well on the benchmarks.
## Claude 3.5 Sonnet takes the top spot
Claude 3.5 Sonnet is now the top ranked model on aider's code editing leaderboard.
DeepSeek Coder V2 previously took the #1 spot, only 4 days ago.
DeepSeek Coder V2 took the #1 spot only 4 days ago.
Sonnet ranked #1 when using the "whole" editing format,
but it also scored very well with
aider's "diff" editing format.
This format allows it to return code changes as diffs -- saving time and token costs,
and making it practical to work with larger source files.
As such, aider uses "diff" by default with this new Sonnet model.
## Code editing leaderboard