aider/aider/website/_posts/2024-09-26-senior-junior.md

title	excerpt	highlight_image	draft	nav_exclude
A draft post.	With a draft summary.	/assets/linting.jpg	true	true

{% if page.date %}

{{ page.date | date: "%B %d, %Y" }}

{% endif %}

Separating code reasoning and editing

Here's a table containing the benchmark data for different model configurations:

{% assign sorted_data = site.data.senior | sort: "pass_rate_2" | reverse %} {% assign grouped_data = sorted_data | group_by: "model" %}

{% for group in grouped_data %} {% assign group_class = forloop.index | modulo: 2 | plus: 1 %} {% for item in group.items %} {% endfor %} {% endfor %}

Senior	Junior	Edit Format	Pass Rate (%)	Average Time (sec)	Total Cost ($)
{{ item.model }}	{{ item.junior_model }}	{{ item.junior_edit_format | default: item.edit_format }}	{{ item.pass_rate_2 }}	{{ item.seconds_per_case }}	{{ item.total_cost }}

This table provides a comparison of different model configurations, showing their performance in terms of pass rate, processing time, and cost. The data is grouped by the Senior model and sorted by the highest Pass Rate within each group (in descending order). Within groups, rows are sorted by decreasing Pass Rate.