Commit graph

17 commits

Author SHA1 Message Date
Paul Gauthier
56519361e2 move into website/ 2024-06-05 14:28:39 -07:00
Paul Gauthier
8c77cf63fd Adapted content for just the docs 2024-06-05 12:29:32 -07:00
Paul Gauthier
8a960083c7 updated chat transcript divs 2024-05-17 12:51:13 -07:00
paul-gauthier
014ec6365e
Update 2024-05-13-models-over-time.md 2024-05-16 19:51:21 -07:00
Paul Gauthier
07c5cae982 copy 2024-05-16 18:17:17 -07:00
Paul Gauthier
2cd2f5439a copy 2024-05-16 18:15:28 -07:00
Paul Gauthier
6331edd954 copy 2024-05-16 18:15:11 -07:00
Paul Gauthier
47eebdb716 copy 2024-05-16 18:12:24 -07:00
Paul Gauthier
8c0bfeb392 copy 2024-05-16 18:09:41 -07:00
Paul Gauthier
6fe67d1132 added blog 2024-05-16 18:06:04 -07:00
Paul Gauthier
4a0b5bbc09 remove 2024-05-15 10:59:18 -07:00
Paul Gauthier
b30e9de61a aider: Updated xAxes and yAxes settings to the new x and y settings in the latest Chart.js version.
# Aider chat conversation:

USER: none of the xAxes or yAxes settings are having any effect

ASSISTANT: The issue might be due to the fact that the Chart.js version you are using has different configuration options. Let's update the configuration to use the latest Chart.js settings.

Here are the changes:

_posts/2024-05-13-models-over-time.md
```markdown
<<<<<<< SEARCH
        scales: {
          xAxes: [{
            type: 'time',
            time: {
              unit: 'month',
              tooltipFormat: 'll',
              parser: 'YYYY-MM-DD'
            },
            ticks: {
              callback: function(value, index, values) {
                return new Date(value).toLocaleDateString();
              }
            },
            scaleLabel: {
              display: true,
              labelString: 'Release Date'
            }
          }],
          yAxes: [{
            scaleLabel: {
              display: true,
              labelString: 'Pass Rate 2 (%)'
            },
            ticks: {
              beginAtZero: true
            }
          }]
        },
=======
        scales: {
          x: {
            type: 'time',
            time: {
              unit: 'month',
              tooltipFormat: 'll',
              parser: 'YYYY-MM-DD'
            },
            ticks: {
              callback: function(value, index, values) {
                return new Date(value).toLocaleDateString();
              }
            },
            title: {
              display: true,
              text: 'Release Date'
            }
          },
          y: {
            title: {
              display: true,
              text: 'Pass Rate 2 (%)'
            },
            beginAtZero: true
          }
        },
>>>>>>> REPLACE
```

This change updates the `xAxes` and `yAxes` settings to the new `x` and `y` settings used in the latest version of Chart.js.
2024-05-15 10:54:26 -07:00
Paul Gauthier
10bb7c7402 aider: Fixed the issue with dates not being shown correctly on the x-axis.
# Aider chat conversation:

USER: the dates aren't being shown as dates on the x-axis. they are coming out as large integers like 1,888,000,000,000

ASSISTANT: To fix the issue with the dates not being shown correctly on the x-axis, we need to modify the `xAxes` configuration in the Chart.js options. Here's the *SEARCH/REPLACE block* with the necessary changes:

_posts/2024-05-13-models-over-time.md
```markdown
<<<<<<< SEARCH
          xAxes: [{
            type: 'time',
            time: {
              unit: 'month',
              tooltipFormat: 'll'
            },
=======
          xAxes: [{
            type: 'time',
            time: {
              unit: 'month',
              tooltipFormat: 'll',
              parser: 'YYYY-MM-DD'
            },
            ticks: {
              callback: function(value, index, values) {
                return new Date(value).toLocaleDateString();
              }
            },
>>>>>>> REPLACE
```

The changes made are:

1. Added the `parser: 'YYYY-MM-DD'` option to the `time` configuration to specify the date format used in the data.
2. Added a `ticks.callback` function to format the tick labels on the x-axis as localized date strings.

These modifications should ensure that the dates are displayed correctly on the x-axis of the scatter plot.
2024-05-15 10:48:18 -07:00
Paul Gauthier
07963921f9 Converted the date format in the chart data from full timestamp to just date. 2024-05-15 10:48:16 -07:00
Paul Gauthier
cacff017d0 aider: Fix the dates being shown as large integers by correctly parsing them as JavaScript Date objects in the data processing script.
# Aider chat conversation:

USER: the dates aren't being shown as dates on the x-axis. they are coming out as large integers like 1,888,000,000,000

ASSISTANT: To fix the issue with the dates being shown as large integers, we need to ensure that the dates are correctly parsed as JavaScript Date objects. We can achieve this by modifying the data processing part of the script.

Here is the *SEARCH/REPLACE* block to fix the issue:

_posts/2024-05-13-models-over-time.md
```markdown
<<<<<<< SEARCH
                x: new Date('{{ row.released }}'),
=======
                x: new Date('{{ row.released | date: "%Y-%m-%dT%H:%M:%S" }}'),
>>>>>>> REPLACE
```

This change ensures that the date string is correctly formatted for JavaScript's `Date` object.
2024-05-15 10:44:27 -07:00
Paul Gauthier
547a07fadc aider: Added scatter plot of edit_leaderboard models with released dates in _posts/2024-05-13-models-over-time.md.
# Aider chat conversation:

USER: draw a scatter plot of the edit_leaderboard models which have `released` dates. With x as the release date, y as the `pass_rate_2` and label each point with the `model` name field. use a chart style similar to the bar graph in the leaderboard.md, but we want a scatter plot for this one. put the scatter plot in the new blog post

ASSISTANT: Let's add the scatter plot to the new blog post in `_posts/2024-05-13-models-over-time.md`.

Here is the *SEARCH/REPLACE* block to add the scatter plot:

_posts/2024-05-13-models-over-time.md
```markdown
<<<<<<< SEARCH
# LLM code editing skill over time
=======
# LLM code editing skill over time

<canvas id="scatterPlot" width="800" height="450" style="margin-top: 20px"></canvas>
<script src="https://cdn.jsdelivr.net/npm/chart.js"></script>
<script>
  document.addEventListener('DOMContentLoaded', function () {
    var ctx = document.getElementById('scatterPlot').getContext('2d');
    var scatterData = {
      datasets: [{
        label: 'Model Performance',
        data: [
          {% for row in site.data.edit_leaderboard %}
            {% if row.released %}
              {
                x: new Date('{{ row.released }}'),
                y: {{ row.pass_rate_2 }},
                label: '{{ row.model }}'
              },
            {% endif %}
          {% endfor %}
        ],
        backgroundColor: 'rgba(54, 162, 235, 0.2)',
        borderColor: 'rgba(54, 162, 235, 1)',
        borderWidth: 1,
        pointRadius: 5,
        pointHoverRadius: 7
      }]
    };

    var scatterChart = new Chart(ctx, {
      type: 'scatter',
      data: scatterData,
      options: {
        scales: {
          xAxes: [{
            type: 'time',
            time: {
              unit: 'month',
              tooltipFormat: 'll'
            },
            scaleLabel: {
              display: true,
              labelString: 'Release Date'
            }
          }],
          yAxes: [{
            scaleLabel: {
              display: true,
              labelString: 'Pass Rate 2 (%)'
            },
            ticks: {
              beginAtZero: true
            }
          }]
        },
        tooltips: {
          callbacks: {
            label: function(tooltipItem, data) {
              var label = data.datasets[tooltipItem.datasetIndex].data[tooltipItem.index].label || '';
              return label + ': (' + tooltipItem.xLabel + ', ' + tooltipItem.yLabel + '%)';
            }
          }
        }
      }
    });
  });
</script>
>>>>>>> REPLACE
```
2024-05-15 09:32:41 -07:00
Paul Gauthier
8f36dff6d8 Added _posts/2024-05-13-models-over-time.md. 2024-05-15 09:32:40 -07:00