dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-28 08:14:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 4

copy

Browse source
This commit is contained in:
Paul Gauthier 2023-11-06 18:37:13 -08:00
parent f658a6575a
commit 93aa497220
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
docs/benchmarks-1106.md
View file

@ -25,7 +25,7 @@ and a test suite to evaluate whether the coder has correctly solved the problem.
The benchmark that aider uses gives GPT two tries to complete the task:
1. On the first try, GPT is given the stub code file to edit and the natural language instructions that describe the problem.
2. If the tests fail after the first try, GPT gets to see the test suite error output and try to fix the code.
2. If the test suite fails after the first try, GPT gets to see the test error output and try to fix the code. Aider supports this sort of interaction when chatting with GPT by letting users `/run pytest` and share the results in the chat. You can `/run` whatever tests/linters/etc make sense for your language/framework/situation.
[OpenAI just released new versions of GPT-3.5 and GPT-4](https://openai.com/blog/new-models-and-developer-products-announced-at-devday),
and there's a lot
@ -48,7 +48,7 @@ indicative of the full benchmark.
## gpt-3.5-turbo-1106
- The new `gpt-3.5-turbo-1106` model is completing the benchmark **3-4X faster** than the earlier GPT-3.5 models.
- The overall success rate after the first and second tries seems comparable to the earlier models.
- The overall success rate after the first and second tries seems comparable or a bit better than the earlier models.
## Updates