dearwolf/aider
1
0
Fork 0
mirror of https://github.com/Aider-AI/aider.git synced 2025-05-30 09:14:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

copy

Browse source
This commit is contained in:
Paul Gauthier 2023-11-06 18:48:14 -08:00
parent 93aa497220
commit 35754247b4
3 changed files with 103 additions and 84 deletions
Download patch file Download diff file Expand all files Collapse all files

180
assets/benchmarks-1106.svg
View file

@ -6,7 +6,7 @@
<rdf:RDF xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:cc="http://creativecommons.org/ns#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"> <rdf:RDF xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:cc="http://creativecommons.org/ns#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
<cc:Work> <cc:Work>
<dc:type rdf:resource="http://purl.org/dc/dcmitype/StillImage"/> <dc:type rdf:resource="http://purl.org/dc/dcmitype/StillImage"/>
<dc:date>2023-11-06T18:21:59.967861</dc:date> <dc:date>2023-11-06T18:47:53.342618</dc:date>
<dc:format>image/svg+xml</dc:format> <dc:format>image/svg+xml</dc:format>
<dc:creator> <dc:creator>
<cc:Agent> <cc:Agent>
@ -41,12 +41,12 @@ z
<g id="xtick_1"> <g id="xtick_1">
<g id="line2d_1"> <g id="line2d_1">
<defs> <defs>
<path id="m807e8d0076" d="M 0 0 <path id="m08b82fc2c8" d="M 0 0
L 0 3.5 L 0 3.5
" style="stroke: #000000; stroke-width: 0.8"/> " style="stroke: #000000; stroke-width: 0.8"/>
</defs> </defs>
<g> <g>
<use xlink:href="#m807e8d0076" x="63.35774" y="239.24" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#m08b82fc2c8" x="63.35774" y="239.24" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_1"> <g id="text_1">
@ -363,7 +363,7 @@ z
<g id="xtick_2"> <g id="xtick_2">
<g id="line2d_2"> <g id="line2d_2">
<g> <g>
<use xlink:href="#m807e8d0076" x="128.411046" y="239.24" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#m08b82fc2c8" x="128.411046" y="239.24" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_2"> <g id="text_2">
@ -428,7 +428,7 @@ z
<g id="xtick_3"> <g id="xtick_3">
<g id="line2d_3"> <g id="line2d_3">
<g> <g>
<use xlink:href="#m807e8d0076" x="193.464352" y="239.24" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#m08b82fc2c8" x="193.464352" y="239.24" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_3"> <g id="text_3">
@ -461,7 +461,7 @@ z
<g id="xtick_4"> <g id="xtick_4">
<g id="line2d_4"> <g id="line2d_4">
<g> <g>
<use xlink:href="#m807e8d0076" x="258.517658" y="239.24" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#m08b82fc2c8" x="258.517658" y="239.24" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_4"> <g id="text_4">
@ -507,7 +507,7 @@ z
<g id="xtick_5"> <g id="xtick_5">
<g id="line2d_5"> <g id="line2d_5">
<g> <g>
<use xlink:href="#m807e8d0076" x="323.570964" y="239.24" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#m08b82fc2c8" x="323.570964" y="239.24" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_5"> <g id="text_5">
@ -532,7 +532,7 @@ z
<g id="xtick_6"> <g id="xtick_6">
<g id="line2d_6"> <g id="line2d_6">
<g> <g>
<use xlink:href="#m807e8d0076" x="388.62427" y="239.24" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#m08b82fc2c8" x="388.62427" y="239.24" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_6"> <g id="text_6">
@ -766,16 +766,16 @@ z
<g id="line2d_7"> <g id="line2d_7">
<path d="M 47.81 239.24 <path d="M 47.81 239.24
L 404.17201 239.24 L 404.17201 239.24
" clip-path="url(#pfe7eb7d67f)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/> " clip-path="url(#pacb09cb929)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/>
</g> </g>
<g id="line2d_8"> <g id="line2d_8">
<defs> <defs>
<path id="m13ec409ae4" d="M 0 0 <path id="mef7a8aafbe" d="M 0 0
L -3.5 0 L -3.5 0
" style="stroke: #000000; stroke-width: 0.8"/> " style="stroke: #000000; stroke-width: 0.8"/>
</defs> </defs>
<g> <g>
<use xlink:href="#m13ec409ae4" x="47.81" y="239.24" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#mef7a8aafbe" x="47.81" y="239.24" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_7"> <g id="text_7">
@ -789,11 +789,11 @@ L -3.5 0
<g id="line2d_9"> <g id="line2d_9">
<path d="M 47.81 196.530625 <path d="M 47.81 196.530625
L 404.17201 196.530625 L 404.17201 196.530625
" clip-path="url(#pfe7eb7d67f)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/> " clip-path="url(#pacb09cb929)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/>
</g> </g>
<g id="line2d_10"> <g id="line2d_10">
<g> <g>
<use xlink:href="#m13ec409ae4" x="47.81" y="196.530625" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#mef7a8aafbe" x="47.81" y="196.530625" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_8"> <g id="text_8">
@ -835,11 +835,11 @@ z
<g id="line2d_11"> <g id="line2d_11">
<path d="M 47.81 153.82125 <path d="M 47.81 153.82125
L 404.17201 153.82125 L 404.17201 153.82125
" clip-path="url(#pfe7eb7d67f)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/> " clip-path="url(#pacb09cb929)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/>
</g> </g>
<g id="line2d_12"> <g id="line2d_12">
<g> <g>
<use xlink:href="#m13ec409ae4" x="47.81" y="153.82125" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#mef7a8aafbe" x="47.81" y="153.82125" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_9"> <g id="text_9">
@ -854,11 +854,11 @@ L 404.17201 153.82125
<g id="line2d_13"> <g id="line2d_13">
<path d="M 47.81 111.111875 <path d="M 47.81 111.111875
L 404.17201 111.111875 L 404.17201 111.111875
" clip-path="url(#pfe7eb7d67f)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/> " clip-path="url(#pacb09cb929)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/>
</g> </g>
<g id="line2d_14"> <g id="line2d_14">
<g> <g>
<use xlink:href="#m13ec409ae4" x="47.81" y="111.111875" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#mef7a8aafbe" x="47.81" y="111.111875" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_10"> <g id="text_10">
@ -873,11 +873,11 @@ L 404.17201 111.111875
<g id="line2d_15"> <g id="line2d_15">
<path d="M 47.81 68.4025 <path d="M 47.81 68.4025
L 404.17201 68.4025 L 404.17201 68.4025
" clip-path="url(#pfe7eb7d67f)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/> " clip-path="url(#pacb09cb929)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/>
</g> </g>
<g id="line2d_16"> <g id="line2d_16">
<g> <g>
<use xlink:href="#m13ec409ae4" x="47.81" y="68.4025" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#mef7a8aafbe" x="47.81" y="68.4025" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_11"> <g id="text_11">
@ -933,11 +933,11 @@ z
<g id="line2d_17"> <g id="line2d_17">
<path d="M 47.81 25.693125 <path d="M 47.81 25.693125
L 404.17201 25.693125 L 404.17201 25.693125
" clip-path="url(#pfe7eb7d67f)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/> " clip-path="url(#pacb09cb929)" style="fill: none; stroke: #b0b0b0; stroke-width: 0.2; stroke-linecap: square"/>
</g> </g>
<g id="line2d_18"> <g id="line2d_18">
<g> <g>
<use xlink:href="#m13ec409ae4" x="47.81" y="25.693125" style="stroke: #000000; stroke-width: 0.8"/> <use xlink:href="#mef7a8aafbe" x="47.81" y="25.693125" style="stroke: #000000; stroke-width: 0.8"/>
</g> </g>
</g> </g>
<g id="text_12"> <g id="text_12">
@ -1199,17 +1199,17 @@ z
<g id="patch_3"> <g id="patch_3">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_4"> <g id="patch_4">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_5"> <g id="patch_5">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_6"> <g id="patch_6">
<path d="M 233.146869 239.24 <path d="M 233.146869 239.24
@ -1217,7 +1217,7 @@ L 257.867125 239.24
L 257.867125 104.368289 L 257.867125 104.368289
L 233.146869 104.368289 L 233.146869 104.368289
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_7"> <g id="patch_7">
<path d="M 298.200175 239.24 <path d="M 298.200175 239.24
@ -1225,15 +1225,15 @@ L 322.920431 239.24
L 322.920431 102.762674 L 322.920431 102.762674
L 298.200175 102.762674 L 298.200175 102.762674
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_8"> <g id="patch_8">
<path d="M 363.25348 239.24 <path d="M 363.25348 239.24
L 387.973737 239.24 L 387.973737 239.24
L 387.973737 98.218479 L 387.973737 96.875417
L 363.25348 98.218479 L 363.25348 96.875417
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_9"> <g id="patch_9">
<path d="M 64.008273 239.24 <path d="M 64.008273 239.24
@ -1241,38 +1241,38 @@ L 88.728529 239.24
L 88.728529 115.607599 L 88.728529 115.607599
L 64.008273 115.607599 L 64.008273 115.607599
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_10"> <g id="patch_10">
<path d="M 129.061579 239.24 <path d="M 129.061579 239.24
L 153.781835 239.24 L 153.781835 239.24
L 153.781835 131.663755 L 153.781835 132.466562
L 129.061579 131.663755 L 129.061579 132.466562
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_11"> <g id="patch_11">
<path d="M 194.114885 239.24 <path d="M 194.114885 239.24
L 218.835141 239.24 L 218.835141 239.24
L 218.835141 115.607599 L 218.835141 120.424445
L 194.114885 115.607599 L 194.114885 120.424445
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_12"> <g id="patch_12">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_13"> <g id="patch_13">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_14"> <g id="patch_14">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_15"> <g id="patch_15">
<path d="M 47.81 239.24 <path d="M 47.81 239.24
@ -1360,10 +1360,26 @@ z
</g> </g>
</g> </g>
<g id="text_16"> <g id="text_16">
<!-- 66% --> <!-- 67% -->
<g transform="translate(369.60939 92.967854) scale(0.06 -0.06)"> <g transform="translate(369.60939 91.624792) scale(0.06 -0.06)">
<defs>
<path id="Helvetica-37" d="M 3347 4400
L 3347 3909
Q 3131 3700 2773 3181
Q 2416 2663 2141 2063
Q 1869 1478 1728 997
Q 1638 688 1494 0
L 872 0
Q 1084 1281 1809 2550
Q 2238 3294 2709 3834
L 234 3834
L 234 4400
L 3347 4400
z
" transform="scale(0.015625)"/>
</defs>
<use xlink:href="#Helvetica-36"/> <use xlink:href="#Helvetica-36"/>
<use xlink:href="#Helvetica-36" x="55.615234"/> <use xlink:href="#Helvetica-37" x="55.615234"/>
<use xlink:href="#Helvetica-25" x="111.230469"/> <use xlink:href="#Helvetica-25" x="111.230469"/>
</g> </g>
</g> </g>
@ -1377,34 +1393,34 @@ z
</g> </g>
<g id="text_18"> <g id="text_18">
<!-- 50% --> <!-- 50% -->
<g transform="translate(135.417488 126.41313) scale(0.06 -0.06)"> <g transform="translate(135.417488 127.215937) scale(0.06 -0.06)">
<use xlink:href="#Helvetica-35"/> <use xlink:href="#Helvetica-35"/>
<use xlink:href="#Helvetica-30" x="55.615234"/> <use xlink:href="#Helvetica-30" x="55.615234"/>
<use xlink:href="#Helvetica-25" x="111.230469"/> <use xlink:href="#Helvetica-25" x="111.230469"/>
</g> </g>
</g> </g>
<g id="text_19"> <g id="text_19">
<!-- 58% --> <!-- 56% -->
<g transform="translate(200.470794 110.356974) scale(0.06 -0.06)"> <g transform="translate(200.470794 115.17382) scale(0.06 -0.06)">
<use xlink:href="#Helvetica-35"/> <use xlink:href="#Helvetica-35"/>
<use xlink:href="#Helvetica-38" x="55.615234"/> <use xlink:href="#Helvetica-36" x="55.615234"/>
<use xlink:href="#Helvetica-25" x="111.230469"/> <use xlink:href="#Helvetica-25" x="111.230469"/>
</g> </g>
</g> </g>
<g id="patch_19"> <g id="patch_19">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_20"> <g id="patch_20">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_21"> <g id="patch_21">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_22"> <g id="patch_22">
<path d="M 233.146869 239.24 <path d="M 233.146869 239.24
@ -1412,7 +1428,7 @@ L 257.867125 239.24
L 257.867125 138.086217 L 257.867125 138.086217
L 233.146869 138.086217 L 233.146869 138.086217
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_23"> <g id="patch_23">
<path d="M 298.200175 239.24 <path d="M 298.200175 239.24
@ -1420,15 +1436,15 @@ L 322.920431 239.24
L 322.920431 139.691833 L 322.920431 139.691833
L 298.200175 139.691833 L 298.200175 139.691833
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_24"> <g id="patch_24">
<path d="M 363.25348 239.24 <path d="M 363.25348 239.24
L 387.973737 239.24 L 387.973737 239.24
L 387.973737 118.36441 L 387.973737 116.648275
L 363.25348 118.36441 L 363.25348 116.648275
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3e6a8; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_25"> <g id="patch_25">
<path d="M 64.008273 239.24 <path d="M 64.008273 239.24
@ -1436,38 +1452,38 @@ L 88.728529 239.24
L 88.728529 131.663755 L 88.728529 131.663755
L 64.008273 131.663755 L 64.008273 131.663755
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_26"> <g id="patch_26">
<path d="M 129.061579 239.24 <path d="M 129.061579 239.24
L 153.781835 239.24 L 153.781835 239.24
L 153.781835 157.353604 L 153.781835 156.733253
L 129.061579 157.353604 L 129.061579 156.733253
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_27"> <g id="patch_27">
<path d="M 194.114885 239.24 <path d="M 194.114885 239.24
L 218.835141 239.24 L 218.835141 239.24
L 218.835141 152.536758 L 218.835141 150.931142
L 194.114885 152.536758 L 194.114885 150.931142
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_28"> <g id="patch_28">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_29"> <g id="patch_29">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_30"> <g id="patch_30">
<path d="M 0 0 <path d="M 0 0
z z
" clip-path="url(#pfe7eb7d67f)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/> " clip-path="url(#pacb09cb929)" style="fill: #b3d1e6; stroke: #ffffff; stroke-width: 1.5; stroke-linejoin: miter"/>
</g> </g>
<g id="patch_31"> <g id="patch_31">
<path d="M 173.810025 81.819122 <path d="M 173.810025 81.819122
@ -1572,12 +1588,12 @@ z
</g> </g>
</g> </g>
<g id="patch_32"> <g id="patch_32">
<path d="M 241.57687 70.512086 <path d="M 242.880586 70.669289
Q 223.525026 86.516597 216.981829 112.354787 Q 223.11873 88.126815 216.883117 116.606052
" style="fill: none; stroke: #000000; stroke-linecap: round"/> " style="fill: none; stroke: #000000; stroke-linecap: round"/>
<path d="M 219.902581 108.968166 <path d="M 219.692379 113.126389
L 216.981829 112.354787 L 216.883117 116.606052
L 216.024983 107.986213 L 215.784944 112.270845
" style="fill: none; stroke: #000000; stroke-linecap: round"/> " style="fill: none; stroke: #000000; stroke-linecap: round"/>
</g> </g>
<g id="text_21"> <g id="text_21">
@ -1635,19 +1651,21 @@ z
<use xlink:href="#Helvetica-74" x="672.65625"/> <use xlink:href="#Helvetica-74" x="672.65625"/>
<use xlink:href="#Helvetica-2c" x="700.439453"/> <use xlink:href="#Helvetica-2c" x="700.439453"/>
</g> </g>
<!-- based on --> <!-- includingn -->
<g transform="translate(257.461775 54.431719) scale(0.1 -0.1)"> <g transform="translate(255.518025 54.459844) scale(0.1 -0.1)">
<use xlink:href="#Helvetica-62"/> <use xlink:href="#Helvetica-69"/>
<use xlink:href="#Helvetica-61" x="55.615234"/> <use xlink:href="#Helvetica-6e" x="22.216797"/>
<use xlink:href="#Helvetica-73" x="111.230469"/> <use xlink:href="#Helvetica-63" x="77.832031"/>
<use xlink:href="#Helvetica-65" x="161.230469"/> <use xlink:href="#Helvetica-6c" x="127.832031"/>
<use xlink:href="#Helvetica-64" x="216.845703"/> <use xlink:href="#Helvetica-75" x="150.048828"/>
<use xlink:href="#Helvetica-20" x="272.460938"/> <use xlink:href="#Helvetica-64" x="205.664062"/>
<use xlink:href="#Helvetica-6f" x="300.244141"/> <use xlink:href="#Helvetica-69" x="261.279297"/>
<use xlink:href="#Helvetica-6e" x="355.859375"/> <use xlink:href="#Helvetica-6e" x="283.496094"/>
<use xlink:href="#Helvetica-67" x="339.111328"/>
<use xlink:href="#Helvetica-6e" x="394.726562"/>
</g> </g>
<!-- unit test errors --> <!-- unit test errors -->
<g transform="translate(246.080525 65.124219) scale(0.1 -0.1)"> <g transform="translate(246.080525 65.280469) scale(0.1 -0.1)">
<use xlink:href="#Helvetica-75"/> <use xlink:href="#Helvetica-75"/>
<use xlink:href="#Helvetica-6e" x="55.615234"/> <use xlink:href="#Helvetica-6e" x="55.615234"/>
<use xlink:href="#Helvetica-69" x="111.230469"/> <use xlink:href="#Helvetica-69" x="111.230469"/>
@ -1861,7 +1879,7 @@ z
</g> </g>
</g> </g>
<defs> <defs>
<clipPath id="pfe7eb7d67f"> <clipPath id="pacb09cb929">
<rect x="47.81" y="25.693125" width="356.36201" height="213.546875"/> <rect x="47.81" y="25.693125" width="356.36201" height="213.546875"/>
</clipPath> </clipPath>
</defs> </defs>

Side by side Swipe Overlay

Before

Width:  |  Height:  |  Size: 51 KiB

After

Width:  |  Height:  |  Size: 51 KiB

Before After
Before After

4
benchmark/benchmark.py
View file

@ -196,8 +196,8 @@ def show_stats(dirnames):
arrowprops={"arrowstyle": "->", "connectionstyle": "arc3,rad=0.3"}, arrowprops={"arrowstyle": "->", "connectionstyle": "arc3,rad=0.3"},
) )
ax.annotate( ax.annotate(
"Second attempt,\nbased on\nunit test errors", "Second attempt,\nincludingn\nunit test errors",
xy=(2.55, 58), xy=(2.55, 56),
xytext=(3.5, top), xytext=(3.5, top),
horizontalalignment="center", horizontalalignment="center",
verticalalignment="top", verticalalignment="top",

3
docs/benchmarks-1106.md
View file

@ -48,7 +48,8 @@ indicative of the full benchmark.
## gpt-3.5-turbo-1106 ## gpt-3.5-turbo-1106
- The new `gpt-3.5-turbo-1106` model is completing the benchmark **3-4X faster** than the earlier GPT-3.5 models. - The new `gpt-3.5-turbo-1106` model is completing the benchmark **3-4X faster** than the earlier GPT-3.5 models.
- The overall success rate after the first and second tries seems comparable or a bit better than the earlier models. - The success rate after the first try of 42% is comparable to the previous June (0613) model. They are both worse than the original March (0301) model's 50% result on the first try.
- The 56% success rate after the second try seems comparable to the original March model, and somewhat better than the June model's 50% score.
## Updates ## Updates