dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-06-01 02:05:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

feat: Add dividers between blocks of same senior model in benchmark data table

Browse source
This commit is contained in:
Paul Gauthier (aider) 2024-09-26 08:02:41 -07:00
parent 98e28642f9
commit 1676653ffb
1 changed files with 3 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
aider/website/_posts/2024-09-26-senior-junior.md
View file

@ -16,9 +16,12 @@ Here's a table containing the benchmark data for different model configurations:
| Senior | Junior | Junior Edit Format | Pass Rate 2 (%) | Seconds per Case | Total Cost ($) |
|-------|--------------|---------------------|-----------------|-------------------|----------------|
| claude-3.5-sonnet | claude-3.5-sonnet | junior-diff | 80.5 | 25.1 | 4.95 |
|-------|--------------|---------------------|-----------------|-------------------|----------------|
| gpt-4o | gpt-4o | junior-diff | 75.2 | 18.2 | 6.09 |
|-------|--------------|---------------------|-----------------|-------------------|----------------|
| o1-mini | deepseek | junior-diff | 69.2 | 52.2 | 5.79 |
| o1-mini | gpt-4o | junior-diff | 70.7 | 23.7 | 9.32 |
|-------|--------------|---------------------|-----------------|-------------------|----------------|
| o1-preview | claude-3.5-sonnet | junior-diff | 82.7 | 44.9 | 37.62 |
| o1-preview | deepseek | junior-diff | 80.5 | 73.2 | 35.79 |
| o1-preview | deepseek | junior-whole | 85.0 | 67.4 | 35.32 |