Commit graph

55 commits

Author SHA1 Message Date
Paul Gauthier
b1c3769813 editblock prompt improvement to better edit code in json wrapped formats like ipynb
Confirmed improvements on basic edits to a .ipynb file.
Confirmed no regressions against latest deepseek coder, sonnet, gpt-4o.
2024-08-13 18:51:33 -07:00
Paul Gauthier
535fdfff35 fix: Improve formatting of system information in prompt 2024-08-06 09:55:31 -03:00
Paul Gauthier
b7f8687679 more platform info 2024-07-06 15:37:59 -03:00
Paul Gauthier
42fbe28897 examples_as_sys_msg for sonnet gets 100% compliance on exercism eval 2024-06-24 11:03:29 -07:00
Paul Gauthier
30154957bb Ask for even more concise S/R blocks 2024-06-24 10:50:30 -07:00
Paul Gauthier
7be08c782c Tell Sonnet to make concise SEARCH/REPLACE blocks #705 2024-06-23 17:24:14 -07:00
Paul Gauthier
45e27af589 restored editblock_prompt 2024-06-16 12:09:20 -07:00
Paul Gauthier
a07492b90a moved --vim to Other Settings 2024-06-12 11:30:26 -07:00
Paul Gauthier
e758b01fb6 Merge branch 'main' into swe-bench 2024-05-19 15:20:46 -07:00
Paul Gauthier
642be2a8f0 S/R uniq prompt 2024-05-19 14:22:29 -07:00
Paul Gauthier
5641483a3b S/R will replace all matches 2024-05-19 10:31:36 -07:00
Paul Gauthier
6638efbee4 better prompting for LLM to suggest files 2024-05-14 06:02:16 -07:00
Paul Gauthier
a5bc2e8b97 Added prompt to reply in the users language #597 2024-05-09 14:06:31 -07:00
Paul Gauthier
4eec60f42c updated assistant auto-reply to no files 2024-05-09 11:56:11 -07:00
Paul Gauthier
444d17de93 reverted prompt closer to e9da401, added helpful assistant replies to repo and files messages 2024-05-09 11:27:13 -07:00
Paul Gauthier
5bd875ffbf cleanup stray << HEAD 2024-05-08 13:45:18 -07:00
Paul Gauthier
f256b43043 wip 2024-05-08 13:35:34 -07:00
Paul Gauthier
fb8ed21b13 refactored lazy_prompt in all coders 2024-05-08 13:07:35 -07:00
Paul Gauthier
0d43468aab added rules header 2024-05-04 08:07:15 -07:00
Paul Gauthier
f4b1797998 put filename back outside fences 2024-05-01 11:59:23 -07:00
Paul Gauthier
0fb08896e3 Merge branch 'main' into gemini-editblock-and-examples 2024-05-01 09:02:08 -07:00
Paul Gauthier
d51cada163 make the examples part of the chat 2024-04-30 20:45:49 -07:00
Paul Gauthier
22d90d70c6 prompt copy 2024-04-30 20:24:53 -07:00
Paul Gauthier
2d16ee16ac Make lazy prompt configurable 2024-04-30 07:45:16 -07:00
Paul Gauthier
29eb2f4681 seems to work better 2024-04-23 14:06:08 -07:00
Paul Gauthier
4c330bcd48 Revert "folk prompting"
This reverts commit 29150bc6f4.
2023-12-19 10:40:46 -08:00
Paul Gauthier
29150bc6f4 folk prompting 2023-12-19 09:55:49 -08:00
Paul Gauthier
ef2a1f3875 diff with move hint 2023-12-18 19:09:32 -08:00
Paul Gauthier
d9a301c9f8 laziness24-turbo-diff-never2x 2023-12-18 18:49:30 -08:00
Paul Gauthier
560759f0c0 show the repomap before the added files 2023-12-08 09:18:03 -08:00
Paul Gauthier
5d0e92296a number -> numbered 2023-11-15 13:06:58 -08:00
Paul Gauthier
9cbe114a74 positivity 2023-11-14 11:34:36 -08:00
Paul Gauthier
253354da98 stronger elide prompt 2023-11-14 11:16:39 -08:00
Paul Gauthier
bbc174a8fb just use the Rules as the reminder 2023-11-14 11:01:29 -08:00
Paul Gauthier
df236e4dec stronger prompt to include comments, docstrings 2023-11-14 10:30:02 -08:00
Paul Gauthier
3986da7210 just use a single S/R format system prompt 2023-11-14 10:25:08 -08:00
Paul Gauthier
c63885fe8c More rules, instructions 2023-11-13 15:28:01 -08:00
Paul Gauthier
8a3d4bf14c added second example showing new file 2023-11-13 15:07:15 -08:00
Paul Gauthier
50f457d753 prompt with clear example using multiple S/R blocks on the same file 2023-11-13 14:59:19 -08:00
Paul Gauthier
b3bc8b0f2b Ask for concise S/R blocks 2023-11-02 10:09:18 -07:00
Paul Gauthier
15d3a5d581 Switch from "edit block" to "search/replace block"
Succeeded in tricky task in the grep-ast codebase:
- checkout ed714ffe58734 / tricky-search-and-replace-state
- "read and parse .gitignore once, not each time we recurse `enumerate_files`"
- was having a lot of trouble creating a head/updated block that matched the actual source code
- new search/replace block does much better

Benchmark had *best* try 1 result and *lowest* num_error_outputs ever seen on gpt-4-0613.
Low num_error_outputs means it's less likely to elide/... code in the before block (original/search).

──────────── tmp.benchmarks/2023-10-25-22-03-19--search-and-replace-and-think ─────────────
test-cases: 133
model: gpt-4
edit_format: diff
commit_hash: c9c2ddb
num_error_outputs: 6
num_user_asks: 0
num_exhausted_context_windows 0
test_timeouts: 2

50.4% correct after try 0
66.2% correct after try 1
2023-10-25 15:24:03 -07:00
Paul Gauthier
7871186e0f Stronger prompt to include file path 2023-10-22 11:18:41 -07:00
Paul Gauthier
529079ec01 quote the HEAD 2023-08-09 18:51:11 -03:00
Paul Gauthier
fb80377d18 ORIGINAL/UPDATED -> HEAD/updated 2023-08-09 16:16:43 -03:00
Paul Gauthier
9e64e7bb9d precise edit blocks prompting language 2023-08-09 11:57:00 -03:00
Paul Gauthier
2c53c153b8 Updated ORIGINAL prompting 2023-08-09 11:38:39 -03:00
Paul Gauthier
00512e3d1c no fuzy matching, stronger prompt for whitespace 2023-08-09 08:25:49 -03:00
Paul Gauthier
6c2cafc1ed Removed "pause often to ask the user" prompting 2023-08-08 17:40:45 -03:00
Paul Gauthier
b006b39c6f GPT should ask users to add files to the chat 2023-07-24 14:49:12 -03:00
Paul Gauthier
4bc35a7376 Ask GPT to retry if original block is not found 2023-07-19 17:24:53 -03:00