Commit graph

6122 commits

Author SHA1 Message Date
Paul Gauthier (aider)
5ccdebf2c0 refactor: Extract color assignment logic into a separate function 2024-08-15 09:50:50 -07:00
Paul Gauthier
04e816ff2e copy 2024-08-15 09:49:51 -07:00
Paul Gauthier (aider)
ea38f91c70 feat: Sort x-axis by model name 2024-08-15 08:29:44 -07:00
Paul Gauthier
957374a611 fix: Update code-in-json post with improved formatting and performance details 2024-08-15 08:29:43 -07:00
Paul Gauthier
bf2d5fee03 strict 2024-08-15 08:12:30 -07:00
Paul Gauthier
9982cda508 5 benchmark runs 2024-08-15 08:11:54 -07:00
Paul Gauthier (aider)
341c08be3e feat: average datapoints for each model/edit_format 2024-08-15 08:08:58 -07:00
Paul Gauthier
ed6ebfbdb6 fix: Update post on code in JSON 2024-08-15 08:08:56 -07:00
Paul Gauthier
bac04a2a3d no lint 2024-08-15 06:10:46 -07:00
Paul Gauthier
6ef2b8c0fa copy 2024-08-15 06:05:38 -07:00
Paul Gauthier (aider)
23f89f1d29 feat: Add striped pattern for "Tool call (strict)" format 2024-08-14 20:07:21 -07:00
Paul Gauthier
9b2f317ba3 feat: Add function to create striped canvas pattern 2024-08-14 20:07:20 -07:00
Paul Gauthier
a47a5c9179 fix: update code-in-json.md post with improved styling for code blocks 2024-08-14 20:07:09 -07:00
Paul Gauthier (aider)
0a2d75b966 fix: Apply consistent color and striped pattern to "Tool call (strict)" 2024-08-14 20:05:23 -07:00
paul-gauthier
d0e716ea7d
Update 2024-08-14-code-in-json.md 2024-08-14 19:02:23 -07:00
paul-gauthier
9ab185a88f
Update 2024-08-14-code-in-json.md 2024-08-14 18:57:18 -07:00
paul-gauthier
a951a2afc9
Update 2024-08-14-code-in-json.md 2024-08-14 18:56:01 -07:00
Paul Gauthier
b3ed2c8a48 copy 2024-08-14 16:50:14 -07:00
Paul Gauthier (aider)
7310f0928f feat: Fetch data from YAML file for chart 2024-08-14 16:46:00 -07:00
Paul Gauthier (aider)
957524680a feat: Add bar graph to plot pass_rate_1 by model and edit_format 2024-08-14 16:44:43 -07:00
Paul Gauthier
205a503d64 init 2024-08-14 16:41:22 -07:00
Paul Gauthier
b2211c4a58 initial 2024-08-14 16:41:08 -07:00
Paul Gauthier
e2f14a26af non-strict 2024-08-14 12:56:10 -07:00
Paul Gauthier
2eb1946909 avoid deref missing func 2024-08-14 11:26:47 -07:00
Paul Gauthier
94a26019bd Merge branch 'main' into json-coders 2024-08-14 11:24:28 -07:00
Paul Gauthier
a37220b974 remove spurious except clause 2024-08-14 11:24:16 -07:00
Paul Gauthier
3996c4a7d5 force tool use 2024-08-14 11:21:36 -07:00
Paul Gauthier
675263623d use strict for new gpt4o 2024-08-14 11:14:37 -07:00
Paul Gauthier
5c24a06dc8 Merge branch 'main' into json-coders 2024-08-14 10:50:23 -07:00
Paul Gauthier
fb7bbb982e fix: Change default prompt option to uppercase 'Y' 2024-08-14 10:10:28 -07:00
Paul Gauthier
7534fabcc0 fix: Update config file existence indicator in main.py 2024-08-14 10:06:49 -07:00
Paul Gauthier (aider)
cdab3fd17f feat: mark which of the default_config_files exist in the verbose output 2024-08-14 10:05:55 -07:00
Paul Gauthier
e55513bd79 fix: Update config files search order message 2024-08-14 10:05:18 -07:00
Paul Gauthier (aider)
aaade794a6 feat: Add verbose printing of default config files before reversing 2024-08-14 10:04:12 -07:00
Paul Gauthier
1cc1ce0bd4 fix: load yml config files most specific to least 2024-08-14 10:02:55 -07:00
Paul Gauthier (aider)
95535b9294 fix: Update test_yaml_config_file_loading to correctly access model name 2024-08-14 09:56:07 -07:00
Paul Gauthier (aider)
258132bfd4 fix: Fix YAML configuration file loading 2024-08-14 09:54:26 -07:00
Paul Gauthier (aider)
81ed9c3002 style: Apply linter formatting changes 2024-08-14 09:53:48 -07:00
Paul Gauthier (aider)
db22d298e3 feat: Add comprehensive test for YAML config file loading
The commit message is:

feat: Add comprehensive test for YAML config file loading
2024-08-14 09:53:44 -07:00
Paul Gauthier
1ced72b728 update models-over-time 2024-08-14 06:31:20 -07:00
Paul Gauthier (aider)
0a3c6bfbe7 feat: Change blue color to light blue in plot_over_time function 2024-08-14 06:29:48 -07:00
Paul Gauthier (aider)
d2b4846b95 feat: Replace orange color with purple for "-4o" models 2024-08-14 06:29:13 -07:00
Paul Gauthier (aider)
fb0b348bec fix: Remove unused blue_points variable 2024-08-14 06:28:28 -07:00
Paul Gauthier (aider)
a7290be843 style: Apply linter formatting changes 2024-08-14 06:27:51 -07:00
Paul Gauthier (aider)
1cdbc76974 feat: Connect model family lines in over_time plot 2024-08-14 06:27:48 -07:00
Paul Gauthier
714fd45f4d fix: Update color logic and font size in over_time.py 2024-08-14 06:27:47 -07:00
Paul Gauthier (aider)
1f6cadcc66 style: Refactor conditional logic in color assignment 2024-08-14 06:22:51 -07:00
Paul Gauthier (aider)
c4f70d81b7 feat: add new color for all "-4o-" models except "gpt-4o-mini" 2024-08-14 06:22:48 -07:00
Paul Gauthier (aider)
1f59687e9d style: Format code with linter 2024-08-14 06:21:48 -07:00
Paul Gauthier (aider)
d8c8c51156 The commit message for these changes would be:
feat: Improve graph visualization and add debugging

The changes made in this commit include:

1. Adjusting the y-axis limit to 100 to accommodate the higher pass rate values.
2. Rotating the x-axis labels for better readability.
3. Adding debug print statements to track the progress of figure generation and display.
4. Increasing the figure size for better visibility.
5. Adding additional debugging to ensure the data is being plotted correctly.

These improvements should help with the visualization and debugging of the graph generation process.
2024-08-14 06:21:45 -07:00