aider/aider/website/_posts/2024-09-26-senior-junior.md

68 lines
1.8 KiB
Markdown

---
title: A draft post.
excerpt: With a draft summary.
highlight_image: /assets/linting.jpg
draft: true
nav_exclude: true
---
{% if page.date %}
<p class="post-date">{{ page.date | date: "%B %d, %Y" }}</p>
{% endif %}
# Separating code reasoning and editing
Here's a table containing the benchmark data for different model configurations:
<style>
.shaded td {
background-color: #f2f2f2;
border-top: 1px solid #ccc;
}
table {
border-collapse: collapse;
width: 100%;
}
th {
padding: 8px;
text-align: left;
border-bottom: 1px solid #ddd;
}
th {
background-color: #e2e2e2;
}
</style>
{% assign sorted_data = site.data.senior | sort: "pass_rate_2" | reverse %}
{% assign grouped_data = sorted_data | group_by: "model" %}
<table>
<thead>
<tr>
<th>Senior</th>
<th>Junior</th>
<th>Edit Format</th>
<th>Pass Rate (%)</th>
<th>Average Time (sec)</th>
<th>Total Cost ($)</th>
</tr>
</thead>
<tbody>
{% for group in grouped_data %}
{% assign group_class = forloop.index | modulo: 2 | plus: 1 %}
{% for item in group.items %}
<tr class="{% if group_class == 1 %}shaded{% endif %}">
<td>{{ item.model }}</td>
<td>{{ item.junior_model }}</td>
<td>{{ item.junior_edit_format | default: item.edit_format }}</td>
<td>{{ item.pass_rate_2 }}</td>
<td>{{ item.seconds_per_case }}</td>
<td>{{ item.total_cost }}</td>
</tr>
{% endfor %}
{% endfor %}
</tbody>
</table>
This table provides a comparison of different model configurations, showing their performance in terms of pass rate, processing time, and cost. The data is grouped by the Senior model and sorted by the highest Pass Rate within each group (in descending order). Within groups, rows are sorted by decreasing Pass Rate.