From f6aa09ca858c4c8219536b8b32c3857eed83928f Mon Sep 17 00:00:00 2001 From: Paul Gauthier Date: Tue, 14 Nov 2023 16:05:43 -0800 Subject: [PATCH] copy --- docs/benchmarks-1106.md | 8 +++++++- docs/benchmarks-speed-1106.md | 5 +++++ 2 files changed, 12 insertions(+), 1 deletion(-) diff --git a/docs/benchmarks-1106.md b/docs/benchmarks-1106.md index c99f40fff..c8243ec1f 100644 --- a/docs/benchmarks-1106.md +++ b/docs/benchmarks-1106.md @@ -1,4 +1,4 @@ -# Code editing skill benchmarks for OpenAI's "1106" models +# Code editing benchmarks for OpenAI's "1106" models [![benchmark results](../assets/benchmarks-1106.svg)](https://aider.chat/assets/benchmarks-1106.svg) @@ -74,3 +74,9 @@ for additional information: - [GPT code editing benchmarks](https://aider.chat/docs/benchmarks.html) evaluates the March and June versions of GPT-3.5 and GPT-4. - [Code editing speed benchmarks for OpenAI's "1106" models](https://aider.chat/docs/benchmarks-speed-1106.html) compares the performance of the new GPT models. + + +## Updates + +Last updated 11/14/23. +OpenAI has relaxed rate limits so these results are no longer considered preliminary. diff --git a/docs/benchmarks-speed-1106.md b/docs/benchmarks-speed-1106.md index 21b9395b0..d68ed6656 100644 --- a/docs/benchmarks-speed-1106.md +++ b/docs/benchmarks-speed-1106.md @@ -39,3 +39,8 @@ Some observations: - **GPT-3.5 got 6-11x faster.** The `gpt-3.5-turbo-1106` model is 6-11x faster than the June (0613) version which has been the default `gpt-3.5-turbo` model. - **GPT-4 Turbo is 2-2.5x faster.** The new `gpt-4-1106-preview` model is 2-2.5x faster than the June (0613) version which has been the default `gpt-4` model. - The old March (0301) version of GPT-3.5 is actually faster than the June (0613) version. This was a surprising discovery. + +## Updates + +Last updated 11/14/23. +OpenAI has relaxed rate limits so these results are no longer considered preliminary.