dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-30 17:24:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

copy

Browse source
This commit is contained in:
Paul Gauthier 2023-12-17 16:46:02 -08:00
parent 616aca8656
commit 200cb12504
1 changed files with 2 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

6
docs/unified-diffs.md
View file

@ -25,10 +25,8 @@ designed to both provoke and quantify lazy coding.
It consists of 39 python refactoring tasks, It consists of 39 python refactoring tasks,
which ask GPT to remove a non-trivial method from a class and make it which ask GPT to remove a non-trivial method from a class and make it
a stand alone function. a stand alone function.
GPT-4 Turbo is prone to being lazy on this sort of task, because it's mostly a GPT-4 Turbo is prone to being lazy on this sort of copy/paste task,
"cut & paste" of code from one place in a file to another. by leaving a comment like
Rather than writing out the code, GPT often just leaves
a comment like
"...include the body of the original method..." "...include the body of the original method..."
This new laziness benchmark produced the following results with `gpt-4-1106-preview`: This new laziness benchmark produced the following results with `gpt-4-1106-preview`: