Commit graph

544 commits

Author SHA1 Message Date
paul-gauthier
a496abbfa4
Update leaderboard.md 2024-05-03 18:46:35 -07:00
Paul Gauthier
6eeeb68049 layout 2024-05-03 18:06:47 -07:00
Paul Gauthier
1d1f53601d aider: Centered the "Percent correct" column in the leaderboard table.
# Aider chat conversation:

USER: center align the percent correct column

ASSISTANT: Here is the *SEARCH/REPLACE* block to center align the "Percent correct" column:

docs/leaderboard.md
```markdown
<<<<<<< SEARCH
      <th style="padding: 8px; text-align: left;">Percent correct</th>
=======
      <th style="padding: 8px; text-align: center;">Percent correct</th>
>>>>>>> REPLACE
```
2024-05-03 18:06:22 -07:00
paul-gauthier
b21952a71c
Update leaderboard.md 2024-05-03 17:59:25 -07:00
Paul Gauthier
bf94746614 copy 2024-05-03 17:37:41 -07:00
Paul Gauthier
6f20edd730 layout 2024-05-03 17:30:59 -07:00
Paul Gauthier
a2d16208ab aider: Replaced <pre> tag with <code> tag in leaderboard.md to denote literal code without boxing it.
# Aider chat conversation:

USER: what do the styles on the pre tag do?

ASSISTANT: The `<pre>` tag in the Markdown table is styled with the following CSS:

```css
pre {
  overflow-x: auto;
  white-space: pre-wrap;
}
```

Here's what those styles do:

- `overflow-x: auto;` adds a horizontal scrollbar to the `<pre>` block if the content is wider than the available space. This allows the user to scroll to see long commands without them wrapping or overflowing the table cell.

- `white-space: pre-wrap;` allows the content inside the `<pre>` to wrap to new lines if needed. Normally `<pre>` elements only honor line breaks that are explicitly in the content. With this style, the browser will wrap lines as needed to fit the available width, while still preserving the original line breaks and other whitespace.

So in summary, these styles allow the command examples in the table to be scrolled horizontally if long, while wrapping to multiple lines if needed to fit the cell. This provides a good balance of preserving the original formatting while keeping the content readable and not breaking the table layout.

USER: the pre is putting the text in a pale blue box. what's another way to denote literal code without boxing it?

ASSISTANT: Here are a couple options to denote literal code without using a `<pre>` tag that puts it in a box:

1. Use inline code formatting with backticks, like `this`. This works well for short code snippets within a sentence.

2. Use a `<code>` tag instead of `<pre>`. This will format the text in a monospace font to denote code, but won't put it in a box. You can add CSS to style it further if desired.

Here's a *SEARCH/REPLACE* block to make that change:

docs/leaderboard.md
```markdown
<<<<<<< SEARCH
        <td style="padding: 4px;"><pre style="overflow-x: auto; white-space: pre-wrap;">{{ row.command }}</pre></td>
=======
        <td style="padding: 4px;"><code>{{ row.command }}</code></td>
>>>>>>> REPLACE
```

This replaces the `<pre>` tag with a `<code>` tag. The code will now render inline without the pale blue box, but will still be visibly denoted as code.

You can remove the `overflow-x` and `white-space` styles since they are no longer needed on the `<code>` tag. The browser will wrap the code naturally within the table cell.

Let me know if you would like me to make this change or if you have any other questions!
2024-05-03 17:28:35 -07:00
Paul Gauthier
e99eaf5e90 aider: Reduced font size of table in leaderboard.md
# Aider chat conversation:

USER: make the font smaller for the table

ASSISTANT: Here is the *SEARCH/REPLACE* block to make the font smaller in the table:

docs/leaderboard.md
```markdown
<<<<<<< SEARCH
<table style="width: 90%; max-width: 800px; margin: auto; border-collapse: collapse; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
=======
<table style="width: 90%; max-width: 800px; margin: auto; border-collapse: collapse; box-shadow: 0 2px 4px rgba(0,0,0,0.1); font-size: 14px;">
>>>>>>> REPLACE
```
2024-05-03 17:23:47 -07:00
Paul Gauthier
01cf0c43a0 layout 2024-05-03 17:21:04 -07:00
Paul Gauthier
8aa1e10f2a copy 2024-05-03 17:14:56 -07:00
paul-gauthier
f1871d104a
Update leaderboard.md 2024-05-03 16:27:51 -07:00
paul-gauthier
6f002bf68f
Update leaderboard.md 2024-05-03 16:14:45 -07:00
Paul Gauthier
052df34300 copy 2024-05-03 15:48:43 -07:00
Paul Gauthier
4b0dfc3d05 copy 2024-05-03 15:45:12 -07:00
Paul Gauthier
f3d9d8f08f aider: Styled the table to be 90% wide with a max-width of 800px, centered it, added a box shadow, and made other visual improvements.
# Aider chat conversation:

USER: add some styling to the table. it's very plain right now. it also is a bit too wide for the page and is forcing the user to scroll left/right.

ASSISTANT: ```diff
--- docs/leaderboard.md
+++ docs/leaderboard.md
@@ ... @@
-<table>
+<table style="width: 100%; max-width: 960px; margin: auto; border-collapse: collapse;">
@@ ... @@
-  <thead>
+  <thead style="background-color: #f2f2f2;">
@@ ... @@
-    <tr>
+    <tr style="border-bottom: 1px solid #ddd;">
@@ ... @@
-      <th>Model</th>
-      <th>Percent correct</th>
-      <th>Command</th>
-      <th>Edit format</th>
+      <th style="padding: 8px; text-align: left;">Model</th>
+      <th style="padding: 8px; text-align: left;">Percent correct</th>
+      <th style="padding: 8px; text-align: left;">Command</th>
+      <th style="padding: 8px; text-align: left;">Edit format</th>
@@ ... @@
-      <tr>
+      <tr style="border-bottom: 1px solid #ddd;">
@@ ... @@
-        <td>{{ row.model }}</td>
-        <td>{{ row.second }}%</td>
-        <td><pre>{{ row.command }}</pre></td>
-        <td>{{ row.format }}</td>
+        <td style="padding: 8px;">{{ row.model }}</td>
+        <td style="padding: 8px;">{{ row.second }}%</td>
+        <td style="padding: 8px;"><pre style="overflow-x: auto; white-space: pre-wrap;">{{ row.command }}</pre></td>
+        <td style="padding: 8px;">{{ row.format }}</td>
```

This diff adds some basic styling to the table to make it look less plain and ensures that it fits within the page without causing horizontal scrolling. The `max-width` property is set to `960px`, which is a common width for content on web pages, and `margin: auto` centers the table on the page. The `border-collapse` property is used to make the borders between cells look cleaner. The `background-color` for the table header improves the visual separation of the header from the body. Padding is added to the cells for better readability, and the `overflow-x: auto; white-space: pre-wrap;` styles on the `<pre>` tag ensure that the command text does not force the table to be wider than the page.

ASSISTANT: ```diff
--- docs/leaderboard.md
+++ docs/leaderboard.md
@@ ... @@
-<table>
+<table style="width: 100%; max-width: 960px; margin: auto; border-collapse: collapse;">
@@ ... @@
-  <thead>
+  <thead style="background-color: #f2f2f2;">
@@ ... @@
-    <tr>
+    <tr style="border-bottom: 1px solid #ddd;">
@@ ... @@
-      <th>Model</th>
-      <th>Percent correct</th>
-      <th>Command</th>
-      <th>Edit format</th>
+      <th style="padding: 8px; text-align: left;">Model</th>
+      <th style="padding: 8px; text-align: left;">Percent correct</th>
+      <th style="padding: 8px; text-align: left;">Command</th>
+      <th style="padding: 8px; text-align: left;">Edit format</th>
@@ ... @@
-      <tr>
+      <tr style="border-bottom: 1px solid #ddd;">
@@ ... @@
-        <td>{{ row.model }}</td>
-        <td>{{ row.second }}%</td>
-        <td><pre>{{ row.command }}</pre></td>
-        <td>{{ row.format }}</td>
+        <td style="padding: 8px;">{{ row.model }}</td>
+        <td style="padding: 8px;">{{ row.second }}%</td>
+        <td style="padding: 8px;"><pre style="overflow-x: auto; white-space: pre-wrap;">{{ row.command }}</pre></td>
+        <td style="padding: 8px;">{{ row.format }}</td>
```

This diff adds some basic styling to the table to make it look less plain and ensures that it fits within the page without causing horizontal scrolling. The `max-width` property is set to `960px`, which is a common width for content on web pages, and `margin: auto` centers the table on the page. The `border-collapse` property is used to make the borders between cells look cleaner. The `background-color` for the table header improves the visual separation of the header from the body. Padding is added to the cells for better readability, and the `overflow-x: auto; white-space: pre-wrap;` styles on the `<pre>` tag ensure that the command text does not force the table to be wider than the page.

USER: UnifiedDiffNoMatch: hunk failed to apply!

docs/leaderboard.md does not contain lines that match the diff you provided!
Try again.
DO NOT skip blank lines, comments, docstrings, etc!
The diff needs to apply cleanly to the lines in docs/leaderboard.md!

docs/leaderboard.md does not contain these 1 exact lines in a row:
```
    <tr>
```

ASSISTANT: ```diff
--- docs/leaderboard.md
+++ docs/leaderboard.md
@@ -1,4 +1,4 @@
-<table style="width: 100%; max-width: 960px; margin: auto; border-collapse: collapse;">
+<table style="width: 90%; max-width: 800px; margin: auto; border-collapse: collapse; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
   <thead style="background-color: #f2f2f2;">
     <tr>
       <th style="padding: 8px; text-align: left;">Model</th>
```
2024-05-03 15:33:42 -07:00
Paul Gauthier
d7ddeab294 Updated leaderboard table styling for better readability and aesthetics. 2024-05-03 15:33:41 -07:00
Paul Gauthier
0e79b3dcc6 Update leaderboard to display command in a preformatted block. 2024-05-03 15:33:32 -07:00
Paul Gauthier
471d637694 updated llama3 2024-05-03 15:31:20 -07:00
Paul Gauthier
b476671399 copy 2024-05-03 15:08:38 -07:00
Paul Gauthier
cb42150bba added leaderboard 2024-05-03 14:52:21 -07:00
Paul Gauthier
4825808f85 aider: Added an HTML table to display leaderboard data from _data/leaderboard.csv in the Jekyll site.
# Aider chat conversation:

USER: make an html table for this jekyll site pulling data from `_data/leaderboard.csv`

ASSISTANT: Here is the *SEARCH/REPLACE* block to add an HTML table to `docs/leaderboard.md` using data from `_data/leaderboard.csv`:

docs/leaderboard.md
```markdown
<<<<<<< SEARCH
```
=======
<table>
  <thead>
    <tr>
      <th>Model</th>
      <th>Second</th>
      <th>First</th>
      <th>Format</th>
      <th>Command</th>
      <th>Version</th>
      <th>Commit</th>
      <th>Date</th>
    </tr>
  </thead>
  <tbody>
    {% for row in site.data.leaderboard %}
      <tr>
        <td>{{ row.model }}</td>
        <td>{{ row.second }}</td>
        <td>{{ row.first }}</td>
        <td>{{ row.format }}</td>
        <td>{{ row.command }}</td>
        <td>{{ row.version }}</td>
        <td>{{ row.commit }}</td>
        <td>{{ row.date }}</td>
      </tr>
    {% endfor %}
  </tbody>
</table>
>>>>>>> REPLACE
```

This will:

1. Add an HTML `<table>` element
2. Define the table header row with column names matching the CSV
3. Loop through `site.data.leaderboard` (loaded from the CSV file)
4. Output a `<tr>` table row for each data row
5. Output `<td>` table cells for each column value

When rendered by Jekyll, this will display the leaderboard data in an HTML table on the page.
2024-05-03 14:51:31 -07:00
Paul Gauthier
a34f1a6529 Added documentation for the leaderboard feature. 2024-05-03 14:51:30 -07:00
Paul Gauthier
3e5f0d0c75 copy 2024-05-02 11:34:38 -07:00
Paul Gauthier
707fb80d87 copy 2024-05-02 09:22:09 -07:00
Paul Gauthier
258c466906 copy 2024-05-02 08:31:13 -07:00
Paul Gauthier
1a8ea2f81f added windows setx commands #584 2024-05-02 08:14:24 -07:00
Paul Gauthier
d4c63ca959 Updated the API key environment variable examples in the llms.md documentation. 2024-05-02 08:03:42 -07:00
Paul Gauthier
8800432dd7 aider: Added # Windows: setx versions of all the export commands.
# Aider chat conversation:

USER: add `# Windows: setx` versions of all the `export` commands, like the first one

ASSISTANT: Here are the changes to add `# Windows: setx` versions of all the `export` commands:

docs/llms.md
<source>markdown
<<<<<<< SEARCH
export ANTHROPIC_API_KEY=<your-key>
=======
export ANTHROPIC_API_KEY=<your-key> # Windows: setx ANTHROPIC_API_KEY <your-key>
>>>>>>> REPLACE
</source>

docs/llms.md
<source>markdown
<<<<<<< SEARCH
export GEMINI_API_KEY=<your-key>
=======
export GEMINI_API_KEY=<your-key> # Windows: setx GEMINI_API_KEY <your-key>
>>>>>>> REPLACE
</source>

docs/llms.md
<source>markdown
<<<<<<< SEARCH
export GROQ_API_KEY=<your-key>
=======
export GROQ_API_KEY=<your-key> # Windows: setx GROQ_API_KEY <your-key>
>>>>>>> REPLACE
</source>

docs/llms.md
<source>markdown
<<<<<<< SEARCH
export COHERE_API_KEY=<your-key>
=======
export COHERE_API_KEY=<your-key> # Windows: setx COHERE_API_KEY <your-key>
>>>>>>> REPLACE
</source>

docs/llms.md
<source>markdown
<<<<<<< SEARCH
export AZURE_API_KEY=<your-key>
export AZURE_API_VERSION=2023-05-15
export AZURE_API_BASE=https://example-endpoint.openai.azure.com
=======
export AZURE_API_KEY=<your-key> # Windows: setx AZURE_API_KEY <your-key>
export AZURE_API_VERSION=2023-05-15 # Windows: setx AZURE_API_VERSION 2023-05-15
export AZURE_API_BASE=https://example-endpoint.openai.azure.com # Windows: setx AZURE_API_BASE https://example-endpoint.openai.azure.com
>>>>>>> REPLACE
</source>

docs/llms.md
<source>markdown
<<<<<<< SEARCH
export OPENROUTER_API_KEY=<your-key>
=======
export OPENROUTER_API_KEY=<your-key> # Windows: setx OPENROUTER_API_KEY <your-key>
>>>>>>> REPLACE
</source>

docs/llms.md
<source>markdown
<<<<<<< SEARCH
export OLLAMA_API_BASE=http://127.0.0.1:11434
=======
export OLLAMA_API_BASE=http://127.0.0.1:11434 # Windows: setx OLLAMA_API_BASE http://127.0.0.1:11434
>>>>>>> REPLACE
</source>

docs/llms.md
<source>markdown
<<<<<<< SEARCH
export OPENAI_API_KEY=<your-key>
export OPENAI_API_BASE=https://api.deepseek.com/v1
=======
export OPENAI_API_KEY=<your-key> # Windows: setx OPENAI_API_KEY <your-key>
export OPENAI_API_BASE=https://api.deepseek.com/v1 # Windows: setx OPENAI_API_BASE https://api.deepseek.com/v1
>>>>>>> REPLACE
</source>

docs/llms.md
<source>markdown
<<<<<<< SEARCH
export OPENAI_API_BASE=<your-endpoint-goes-here>

# If your endpoint needs a key
export OPENAI_API_KEY=<your-key>
=======
export OPENAI_API_BASE=<your-endpoint-goes-here> # Windows: setx OPENAI_API_BASE <your-endpoint-goes-here>

# If your endpoint needs a key
export OPENAI_API_KEY=<your-key> # Windows: setx OPENAI_API_KEY <your-key>
>>>>>>> REPLACE
</source>
2024-05-02 07:52:20 -07:00
Paul Gauthier
3b900a4c59 Prep for windows setx 2024-05-02 07:51:01 -07:00
Paul Gauthier
d6783636c5 copy 2024-04-29 20:42:44 -07:00
Paul Gauthier
178af4a327 copy 2024-04-29 13:17:40 -07:00
Paul Gauthier
e668803f82 added deepseek docs 2024-04-29 12:35:57 -07:00
Paul Gauthier
03908c5ab6 copy 2024-04-29 06:35:45 -07:00
Paul Gauthier
8a9005eed1 copy 2024-04-28 17:36:58 -07:00
Paul Gauthier
dd9da6ef6a copy 2024-04-28 17:31:30 -07:00
Paul Gauthier
f8b51ea2df copy 2024-04-28 17:12:23 -07:00
Paul Gauthier
821dd1e18a copy 2024-04-28 17:08:17 -07:00
Paul Gauthier
4efa97201f copy 2024-04-28 11:52:38 -07:00
Paul Gauthier
60d92feaa8 copy 2024-04-24 15:59:52 -07:00
Paul Gauthier
fe6257b513 copy 2024-04-24 14:13:21 -07:00
Paul Gauthier
d89c3caf29 copy 2024-04-23 12:25:41 -07:00
Paul Gauthier
36c78e71bd copy 2024-04-23 12:22:18 -07:00
Paul Gauthier
9afa6e8435 Added gemini 1.5 pro 2024-04-23 09:49:48 -07:00
Paul Gauthier
d260bfb704 copy 2024-04-23 06:30:25 -07:00
Paul Gauthier
9deeccbed3 Merge remote-tracking branch 'origin/main' 2024-04-23 06:29:44 -07:00
Paul Gauthier
fbe3daaa5b copy 2024-04-23 06:29:39 -07:00
paul-gauthier
da24b20597
Update llms.md 2024-04-22 20:33:11 -07:00
paul-gauthier
a5282b157e
Update llms.md 2024-04-22 20:32:20 -07:00
Paul Gauthier
89a7b3470a Use fq model name in --models search 2024-04-22 19:17:27 -07:00
Paul Gauthier
25b8d6fec8 Added --models 2024-04-22 18:45:20 -07:00