Commit graph

7509 commits

Author SHA1 Message Date
Paul Gauthier
7fe3518c8c copy 2024-09-26 11:57:55 -07:00
Paul Gauthier
e2d5545b48 copy 2024-09-26 11:52:47 -07:00
Paul Gauthier
862968ed20 copy 2024-09-26 11:50:25 -07:00
Paul Gauthier
50fb95c8b1 force pip to install aider's deps 2024-09-26 11:47:05 -07:00
Paul Gauthier
6b6f682a94 pip install -> pip install -U 2024-09-26 11:40:48 -07:00
Paul Gauthier
5e419ef8a6 copy 2024-09-26 11:36:40 -07:00
Paul Gauthier
c3b9d34e24 copy 2024-09-26 11:35:33 -07:00
Paul Gauthier (aider)
5a78e7d1b8 chore: Run the linter 2024-09-26 11:35:13 -07:00
Paul Gauthier (aider)
1c05192b69 fix: Only record junior_model and junior_edit_format in the results array if edit_format is "senior" 2024-09-26 11:35:09 -07:00
Paul Gauthier
068ff01cee restor 2024-09-26 11:34:02 -07:00
Paul Gauthier
7feaccd35a cleanup 2024-09-26 11:29:39 -07:00
Paul Gauthier (aider)
bf015e27d6 feat: Add --senior switch as alias for --edit-format senior 2024-09-26 11:27:55 -07:00
Paul Gauthier (aider)
3fe3e0f700 feat: Add --o1-mini and --o1-preview aliases for model selection 2024-09-26 11:27:14 -07:00
Paul Gauthier
b3e3a5a401 better 2024-09-26 11:21:35 -07:00
Paul Gauthier
d375103b64 data 2024-09-26 11:20:22 -07:00
Paul Gauthier (aider)
b7ddd74631 fix: Remove stripes and dots from color patches in legends 2024-09-26 11:19:02 -07:00
Paul Gauthier (aider)
4b6dd92f73 feat: Add polka dot pattern to Deepseek diff bars 2024-09-26 11:17:45 -07:00
Paul Gauthier
aa7949467c feat: Reduce height of pass rate chart to 300px 2024-09-26 11:17:43 -07:00
Paul Gauthier (aider)
0cb8c891d9 feat: Add striped pattern to Deepseek whole bars 2024-09-26 11:16:39 -07:00
Paul Gauthier
1d454c1729 feat: Increase height of pass rate chart to 400px 2024-09-26 11:16:38 -07:00
Paul Gauthier
b867c04354 feat: Implement Senior/Junior approach for code editing 2024-09-26 11:14:19 -07:00
Paul Gauthier (aider)
b4bd5ffb69 feat: add horizontal dashed line at y=79.7 labeled "Previous SOTA" 2024-09-26 10:21:24 -07:00
Paul Gauthier
337b5f1f7a feat: Add new blog post on senior and junior developers 2024-09-26 10:21:23 -07:00
Paul Gauthier (aider)
2d5962ef2f fix: Properly nest x-axis title within x-axis configuration 2024-09-26 10:19:08 -07:00
Paul Gauthier
4f32da2bf0 feat: Add y-axis title to chart in senior-junior blog post 2024-09-26 10:19:07 -07:00
Paul Gauthier (aider)
5378171ed1 feat: add x-axis label to chart 2024-09-26 10:18:04 -07:00
Paul Gauthier
975f35dfbc feat: Add support for using two models to complete each coding task 2024-09-26 10:18:03 -07:00
Paul Gauthier (aider)
a4df572cfe feat: add legend for senior models 2024-09-26 10:12:19 -07:00
Paul Gauthier (aider)
e83c285d4f feat: color each bar based on the Senior model 2024-09-26 10:11:28 -07:00
Paul Gauthier (aider)
10eb25f5f5 feat: add bar graph of pass rate data 2024-09-26 10:10:32 -07:00
Paul Gauthier
04cc9d03e9 feat: Add senior/junior code editing benchmark chart 2024-09-26 10:07:59 -07:00
Paul Gauthier (aider)
c7e2255570 refactor: Change chart type from stacked to grouped bars 2024-09-26 09:43:14 -07:00
Paul Gauthier (aider)
d699f3025d feat: Increase chart height and improve title and axis label readability 2024-09-26 09:42:01 -07:00
Paul Gauthier (aider)
c33dd0ee7b fix: Avoid declaring dataset variable multiple times 2024-09-26 09:40:04 -07:00
Paul Gauthier (aider)
63a4ce0fe2 feat: Add a graph that displays the Pass Rate for each Senior/Junior/EditFormat 2024-09-26 09:39:16 -07:00
Paul Gauthier
222b9cff09 feat: Add support for using two models to complete coding tasks 2024-09-26 09:39:14 -07:00
Paul Gauthier (aider)
89aa385613 style: right-align cost entries in table 2024-09-26 08:31:26 -07:00
Paul Gauthier
ab8672574a fix: Update formatting for seconds per case and total cost in blog post 2024-09-26 08:31:25 -07:00
Paul Gauthier (aider)
034e65912e style: Format cost column to show two decimal places 2024-09-26 08:29:15 -07:00
Paul Gauthier
40bf3a1e58 feat: Update table formatting in blog post 2024-09-26 08:29:14 -07:00
Paul Gauthier (aider)
fb9ffca9ea style: format cost column with two decimal places 2024-09-26 08:27:47 -07:00
Paul Gauthier
fbe0aa2a7b fix: Update table formatting for total_cost column 2024-09-26 08:27:46 -07:00
Paul Gauthier (aider)
3661c2c08a feat: Display cost with two decimal places 2024-09-26 08:26:41 -07:00
Paul Gauthier (aider)
8d22cadd30 style: format cost column as standard money 2024-09-26 08:26:11 -07:00
Paul Gauthier
f691878390 feat: Add edit format column to senior-junior benchmark table 2024-09-26 08:26:09 -07:00
Paul Gauthier (aider)
50570c4762 fix: Display edit_format if junior_edit_format is not available 2024-09-26 08:24:51 -07:00
Paul Gauthier
8ca92cdec0 fix: Update table styles in blog post 2024-09-26 08:24:51 -07:00
Paul Gauthier (aider)
bc1559fbc9 style: Enhance table styling to improve visual distinction of shaded rows 2024-09-26 08:12:19 -07:00
Paul Gauthier (aider)
ac9d46c1f7 feat: Shade every second group of Seniors 2024-09-26 08:11:07 -07:00
Paul Gauthier
fb2e59cf08 fix: Remove unnecessary horizontal rule from table 2024-09-26 08:11:06 -07:00