dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-31 17:55:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 9

copy

Browse source
This commit is contained in:
Paul Gauthier 2023-11-06 18:48:14 -08:00
parent 93aa497220
commit 35754247b4
3 changed files with 103 additions and 84 deletions
Download patch file Download diff file Expand all files Collapse all files

3
docs/benchmarks-1106.md
View file

@ -48,7 +48,8 @@ indicative of the full benchmark.
## gpt-3.5-turbo-1106
- The new `gpt-3.5-turbo-1106` model is completing the benchmark **3-4X faster** than the earlier GPT-3.5 models.
- The overall success rate after the first and second tries seems comparable or a bit better than the earlier models.
- The success rate after the first try of 42% is comparable to the previous June (0613) model. They are both worse than the original March (0301) model's 50% result on the first try.
- The 56% success rate after the second try seems comparable to the original March model, and somewhat better than the June model's 50% score.
## Updates