Commit graph

168 commits

Author SHA1 Message Date
Paul Gauthier
ab55b6ff0a Copy ORIGINAL_DNAME to dirname. 2023-11-08 10:07:27 -08:00
Paul Gauthier
59fed25cd1 copy 2023-11-08 08:36:48 -08:00
Paul Gauthier
2c83287c46 refac 2023-11-08 06:21:16 -08:00
Paul Gauthier
426819e703 copy 2023-11-07 10:53:27 -08:00
Paul Gauthier
5da64a6abc copy 2023-11-07 07:22:26 -08:00
Paul Gauthier
dfb921c509 copy 2023-11-06 20:24:44 -08:00
Paul Gauthier
15a1c754a4 copy 2023-11-06 18:58:24 -08:00
Paul Gauthier
35754247b4 copy 2023-11-06 18:48:14 -08:00
Paul Gauthier
976fc7a836 update benchmarking script 2023-11-06 18:26:02 -08:00
Paul Gauthier
44388dbc6d Updated dev-requirements.in to include all benchmark dependencies 2023-11-06 13:08:48 -08:00
Paul Gauthier
ebbb5bd442 simplify 2023-10-22 11:26:37 -07:00
Paul Gauthier
33cf55e5ae aider: Add build-essential package to Dockerfile.
# Aider chat conversation:

ASSISTANT: To install the core tools needed to build Python wheels, we need to modify the Dockerfile. We will add a new line to install the build-essential package, which includes gcc and other necessary tools.

Here is the edit block for the Dockerfile:

```Dockerfile
benchmark/Dockerfile
<<<<<<< HEAD
FROM python:3.10-slim
RUN apt-get update && apt-get install -y less git
COPY requirements.txt /aider/requirements.txt
RUN pip install --upgrade pip
RUN pip install lox typer pandas matplotlib imgcat aider-chat
RUN pip install -r /aider/requirements.txt
RUN git config --global --add safe.directory /aider
WORKDIR /aider
=======
FROM python:3.10-slim
RUN apt-get update && apt-get install -y less git build-essential
COPY requirements.txt /aider/requirements.txt
RUN pip install --upgrade pip
RUN pip install lox typer pandas matplotlib imgcat aider-chat
RUN pip install -r /aider/requirements.txt
RUN git config --global --add safe.directory /aider
WORKDIR /aider
>>>>>>> updated
```

This change will install the build-essential package after updating the package lists for upgrades and new packages.
2023-10-22 11:22:18 -07:00
Paul Gauthier
98a6d383ab Updated Dockerfile to upgrade pip before installing dependencies. 2023-10-22 11:22:17 -07:00
Joshua Vial
9a91d8fbad set git config safe dir in benchmark docker 2023-09-09 12:07:11 +12:00
Joshua Vial
91b7648f33 update model creation method 2023-09-09 12:06:34 +12:00
Paul Gauthier
aee1338670 copy 2023-09-08 09:49:58 -07:00
Paul Gauthier
491993f979 Added a benchmarking readme 2023-09-08 09:12:34 -07:00
Paul Gauthier
2c53c153b8 Updated ORIGINAL prompting 2023-08-09 11:38:39 -03:00
Paul Gauthier
0aa2ff2cf9 roughed in cache; elide full dirnames from test results to make them deterministic 2023-08-09 11:30:13 -03:00
Paul Gauthier
2eeee67ee5 support --keywords 2023-08-09 11:12:27 -03:00
Paul Gauthier
c43d7e9a69 initial --diffs implementation 2023-08-08 17:40:32 -03:00
Paul Gauthier
568be3812b Fix last_keyboard_interrupt in benchmark 2023-07-20 13:25:15 -03:00
Paul Gauthier
edbec5498e update benchmark driver 2023-07-13 20:02:58 -07:00
Paul Gauthier
44311f4737 preparing for v0.8.0 2023-07-06 14:03:06 -07:00
Paul Gauthier
ba2c5d05da new svg 2023-07-02 10:45:14 -07:00
Paul Gauthier
4ea70bfdc0 new svg 2023-07-02 10:35:11 -07:00
Paul Gauthier
5e4ad5bf00 new svg 2023-07-02 10:28:39 -07:00
Paul Gauthier
8f4a823855 new svg 2023-07-02 10:26:18 -07:00
Paul Gauthier
2915acb9a6 new svg 2023-07-02 10:23:06 -07:00
Paul Gauthier
86ced88f8e new svg 2023-07-02 10:18:58 -07:00
Paul Gauthier
db18876db6 plot the repeat error bars 2023-07-02 07:10:54 -07:00
Paul Gauthier
411c744a15 run repeats 2023-07-02 06:09:27 -07:00
Paul Gauthier
a4ab262d96 new svg 2023-07-01 21:35:38 -07:00
Paul Gauthier
f548f88220 new svg 2023-07-01 21:31:54 -07:00
Paul Gauthier
b9f8ed47f4 copy 2023-07-01 17:50:48 -07:00
Paul Gauthier
8ef166478a graph layout 2023-07-01 17:18:14 -07:00
Paul Gauthier
3f0c752368 show 1st & 2nd coding attempts 2023-07-01 16:40:25 -07:00
Paul Gauthier
f27a869649 new svg 2023-07-01 16:23:09 -07:00
Paul Gauthier
506bfe2076 run gpt-4 benchmarks 2023-07-01 13:31:09 -07:00
Paul Gauthier
bddc5a36f0 cleanup 2023-07-01 13:29:52 -07:00
Paul Gauthier
34b4ab199d show try 1 and 2 2023-07-01 13:28:36 -07:00
Paul Gauthier
bfd68404d4 skip blocked test 2023-07-01 08:19:04 -07:00
Paul Gauthier
1251285ac8 cleaner logging, avoid func formats with old models 2023-07-01 06:59:18 -07:00
Paul Gauthier
6471b89033 return 0 2023-07-01 06:50:13 -07:00
Paul Gauthier
5bc7890bfd rungrid with subproc 2023-07-01 06:33:38 -07:00
Paul Gauthier
0dc4df25c8 changed dirname 2023-07-01 06:21:50 -07:00
Paul Gauthier
8c29ecff28 added rungrid 2023-07-01 06:21:22 -07:00
Paul Gauthier
92e5f43abe intro 2023-06-30 20:42:54 -07:00
Paul Gauthier
5942057a9c introduction.md 2023-06-30 20:39:08 -07:00
Paul Gauthier
c2009fd113 initial 2023-06-30 20:36:44 -07:00