dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-31 09:44:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 9

feat: Add section on overall coding skill and syntax errors to blog post on code in JSON

Browse source
This commit is contained in:
Paul Gauthier 2024-08-15 10:08:13 -07:00 • committed by Paul Gauthier (aider)
parent 822a8ab671
commit 19073dd939
1 changed files with 6 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

6
aider/website/_posts/2024-08-14-code-in-json.md
View file

@ -270,6 +270,9 @@ model & strategy combination.
## Results
## Overall coding skill
All of the models did worse on the benchmark when asked to
return JSON-wrapped code in a tool function call.
Most did significantly worse, performing far below
@ -285,6 +288,9 @@ as compared to non-strict JSON.
Of course, both JSON results were well below the markdown result.
- The results from Sonnet and DeepSeek Coder suffered the worst harm from JSON wrapping.
## Syntax errors
## Conclusions
While the quantitative results differ from the similar