dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-28 08:14:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4

Update unified-diffs.md

Browse source
This commit is contained in:
paul-gauthier 2023-12-18 12:24:43 -08:00 • committed by GitHub
parent fd4e890217
commit 3a119ff1b1
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/unified-diffs.md
View file

@ -22,7 +22,7 @@ often resulting in comments like
This new laziness benchmark produced the following results with `gpt-4-1106-preview`:
- **GPT-4 Turbo only scored 15% as a baseline** using aider's existing "SEARCH/REPLACE block" edit format.
- **Aider's new unified diff edit format raised the score to 65%**.
- **Aider's new unified diff edit format raised the score to 62%**.
- **No benefit from the user being blind, without hands, tipping $2000 or fearing truncated code trauma.** These widely circulated folk remedies performed no better than baseline when added to the system prompt with aider's SEARCH/REPLACE edit format. Including *all* of them still only scored at 15%
The older `gpt-4-0613` also did better on the laziness benchmark using unified diffs: