Commit graph

4262 commits

Author SHA1 Message Date
Paul Gauthier
901d8a1a2a Set linter command as a string and update the result message format. 2024-05-18 19:14:19 -07:00
Paul Gauthier
f43b352949 Fix string interpolation typo in linter output message. 2024-05-18 19:00:43 -07:00
Paul Gauthier
e516f838f5 aider: Fix import sorting in aider/linter.py to resolve isort failure.
# Aider chat conversation:

USER: # Running: {cmd]
If the output below indicates errors or problems, fix them.
But if the command fixed all the issues itself, don't take further action.

isort....................................................................Failed
- hook id: isort
- files were modified by this hook

Fixing /Users/gauthier/Projects/aider/aider/linter.py

black....................................................................Passed
flake8...................................................................Passed

USER: # Running: {cmd]
If the output below indicates errors or problems, fix them.
But if the command fixed all the issues itself, don't take further action.

isort....................................................................Failed
- hook id: isort
- files were modified by this hook

Fixing /Users/gauthier/Projects/aider/aider/linter.py

black....................................................................Passed
flake8...................................................................Passed

ASSISTANT: To fix the `isort` issues, we need to sort the imports in `aider/linter.py`. Here is the *SEARCH/REPLACE* block to apply the necessary changes:

aider/linter.py
```python
<<<<<<< SEARCH
import os
import subprocess
import sys
import traceback
import warnings
from pathlib import Path

from grep_ast import TreeContext, filename_to_lang

from aider.dump import dump  # noqa: F401

# tree_sitter is throwing a FutureWarning
warnings.simplefilter("ignore", category=FutureWarning)

from tree_sitter_languages import get_parser  # noqa: E402
=======
import os
import subprocess
import sys
import traceback
import warnings
from pathlib import Path

from grep_ast import TreeContext, filename_to_lang
from tree_sitter_languages import get_parser  # noqa: E402

from aider.dump import dump  # noqa: F401

# tree_sitter is throwing a FutureWarning
warnings.simplefilter("ignore", category=FutureWarning)
>>>>>>> REPLACE
```
2024-05-18 18:59:39 -07:00
Paul Gauthier
5959e7990a Return the linting results in the Linter class. 2024-05-18 18:59:37 -07:00
Paul Gauthier
2e6c7a13b2 Add detailed error message when non-zero exit status occurs in Linter. 2024-05-18 18:57:14 -07:00
Paul Gauthier
04084883e8 Added a new command to run the linter on dirty files, fix problems, and then commit. 2024-05-18 18:35:33 -07:00
Paul Gauthier
7b8e603249 aider: Shortened the docstring in aider/repo.py to comply with the 100 characters line length limit.
# Aider chat conversation:

USER: I ran this command:

 pre-commit run --files aider/repo.py

And got this output:

isort....................................................................Passed
black....................................................................Passed
flake8...................................................................Failed
- hook id: flake8
- exit code: 1

aider/repo.py:247:101: E501 line too long (111 > 100 characters)
        """
        Returns a list of all files which are dirty (not committed), either staged or in the working directory.
        """

                                                                                        ^

ASSISTANT: Please add the file `aider/repo.py` to the chat so I can make the necessary changes.

USER: I added these files to the chat: aider/repo.py

ASSISTANT: To fix the flake8 error, we need to shorten the docstring to comply with the line length limit of 100 characters.

Here is the *SEARCH/REPLACE* block:

aider/repo.py
```python
<<<<<<< SEARCH
        """
        Returns a list of all files which are dirty (not committed), either staged or in the working directory.
        """
=======
        """
        Returns a list of all files which are dirty (not committed), either staged or in the working
        directory.
        """
>>>>>>> REPLACE
```
2024-05-18 18:30:51 -07:00
Paul Gauthier
abbe5416a1 Refactored GitRepo class to use consistent quotation marks for git commands. 2024-05-18 18:30:50 -07:00
Paul Gauthier
5d8ed278aa aider: Add get_dirty_files() method to return all dirty files staged or in the working directory.
# Aider chat conversation:

USER: add a get_dirty_files() method which returns all the files which are dirty (not committed) either staged or in the working dir.

ASSISTANT: To add the `get_dirty_files()` method, we need to:

1. Define the new method in the `GitRepo` class.
2. Implement the logic to return all dirty files, both staged and in the working directory.

Here is the *SEARCH/REPLACE* block:

aider/repo.py
```python
<<<<<<< SEARCH
    def is_dirty(self, path=None):
=======
    def get_dirty_files(self):
        """
        Returns a list of all files which are dirty (not committed), either staged or in the working directory.
        """
        dirty_files = set()

        # Get staged files
        staged_files = self.repo.git.diff('--name-only', '--cached').splitlines()
        dirty_files.update(staged_files)

        # Get unstaged files
        unstaged_files = self.repo.git.diff('--name-only').splitlines()
        dirty_files.update(unstaged_files)

        return list(dirty_files)

>>>>>>> REPLACE
```

aider/repo.py
```python
<<<<<<< SEARCH
        return self.repo.is_dirty(path=path)
=======
        return self.repo.is_dirty(path=path)
>>>>>>> REPLACE
```
2024-05-18 18:13:08 -07:00
Paul Gauthier
22736b63d0 noop 2024-05-18 18:05:43 -07:00
Paul Gauthier
bc3ed8657e stick with compile() 2024-05-18 17:59:40 -07:00
Paul Gauthier
86facafd09 works 2024-05-18 17:57:35 -07:00
Paul Gauthier
b600e17910 Added traceback information to the linting output. 2024-05-18 17:42:04 -07:00
Paul Gauthier
567c470c0b Refactored error message and added a todo comment for printing out the last call stack. 2024-05-18 17:41:58 -07:00
Paul Gauthier
f699241e12 aider: Change error message format to display the class name instead of the full type.
# Aider chat conversation:

USER:         res = f"{type(err)}: {err}\n" is producing: "<class 'IndentationError'>: unexpected indent (tmp.syntaxerror.py, line 4)" I want it to say "IndentationError: unexpected indent (tmp.syntaxerror.py, line 4)"

ASSISTANT: To change the error message format from `<class 'IndentationError'>: unexpected indent (tmp.syntaxerror.py, line 4)` to `IndentationError: unexpected indent (tmp.syntaxerror.py, line 4)`, we need to modify the line where the error message is being constructed.

Here is the *SEARCH/REPLACE* block:

aider/linter.py
```python
<<<<<<< SEARCH
        res = f"{type(err)}: {err}\n"
=======
        res = f"{type(err).__name__}: {err}\n"
>>>>>>> REPLACE
```
2024-05-18 17:38:26 -07:00
Paul Gauthier
30c9c4c319 Refactored linter to support linting Python code with py_compile. 2024-05-18 17:38:25 -07:00
Paul Gauthier
b26969ea90 Refactored linting to use absolute file path. 2024-05-17 19:22:17 -07:00
Paul Gauthier
0412b19f6b aider: Fix flake8 errors by removing unnecessary f-string prefixes in aider/coders/base_coder.py.
# Aider chat conversation:

USER: I ran this command:

 pre-commit run --files aider/coders/base_coder.py

And got this output:

isort....................................................................Passed
black....................................................................Passed
flake8...................................................................Failed
- hook id: flake8
- exit code: 1

aider/coders/base_coder.py:1135:32: F541 f-string is missing placeholders
            self.io.tool_error(f"The LLM did not conform to the edit format.")
                               ^
aider/coders/base_coder.py:1148:32: F541 f-string is missing placeholders
            self.io.tool_error(f"Exception while updating files:")
                               ^

ASSISTANT: Please add `aider/coders/base_coder.py` to the chat so I can propose the necessary changes to fix the flake8 errors.

USER: I added these *read-write* files: aider/coders/base_coder.py

ASSISTANT: Here are the changes to fix the flake8 errors related to the f-strings missing placeholders in `aider/coders/base_coder.py`:

```diff
--- aider/coders/base_coder.py
+++ aider/coders/base_coder.py
@@ ... @@
-            self.io.tool_error(f"The LLM did not conform to the edit format.")
+            self.io.tool_error("The LLM did not conform to the edit format.")
@@ ... @@
-            self.io.tool_error(f"Exception while updating files:")
+            self.io.tool_error("Exception while updating files:")
```

These changes remove the unnecessary f-string prefixes since there are no variables or expressions to be evaluated inside the strings.
2024-05-17 19:11:49 -07:00
Paul Gauthier
8f194c8313 Add reflection tracking and limit to Coder class. 2024-05-17 19:11:48 -07:00
Paul Gauthier
4b0c38254e added lint reflection 2024-05-17 16:58:04 -07:00
Paul Gauthier
fe65b7d11f roughed in flake8 2024-05-17 16:41:36 -07:00
Paul Gauthier
c7196b8390 aider: Remove unused variable _output in the run_cmd method in aider/linter.py.
# Aider chat conversation:

USER: I ran this command:

 pre-commit run --files aider/linter.py

And got this output:

isort....................................................................Failed
- hook id: isort
- files were modified by this hook

Fixing /Users/gauthier/Projects/aider/aider/linter.py

black....................................................................Failed
- hook id: black
- files were modified by this hook

reformatted aider/linter.py

All done!  🍰 
1 file reformatted.

flake8...................................................................Failed
- hook id: flake8
- exit code: 1

aider/linter.py:37:13: F841 local variable '_output' is assigned to but never used
            _output = subprocess.check_output(cmd, cwd=self.root).decode()
            ^

ASSISTANT: Please add `aider/linter.py` to the chat so I can make the necessary changes to fix the flake8 issue.

USER: I added these files to the chat: aider/linter.py

ASSISTANT: To fix the flake8 issue, we need to remove the unused variable `_output` in the `run_cmd` method. Here is the *SEARCH/REPLACE* block:

aider/linter.py
```python
<<<<<<< SEARCH
            _output = subprocess.check_output(cmd, cwd=self.root).decode()
            return  # zero exit status
=======
            subprocess.check_output(cmd, cwd=self.root).decode()
            return  # zero exit status
>>>>>>> REPLACE
```

This change will remove the assignment to the unused variable `_output` while keeping the call to `subprocess.check_output`.
2024-05-17 15:37:06 -07:00
Paul Gauthier
4f81971a13 Add support for running custom linters and improve error handling. 2024-05-17 15:37:05 -07:00
Paul Gauthier
dc2850b53d Added a Linter class for linting files and refactored linting logic in the main function. 2024-05-17 15:21:09 -07:00
Paul Gauthier
dd2ba6e3fc pin tree-sitter==0.21.3 2024-05-17 14:49:39 -07:00
Paul Gauthier
e09d4d8e16 Upgraded deps to pickup grep-ast 0.3.0 2024-05-17 14:42:40 -07:00
Paul Gauthier
778dbcabb0 aider: Remove the unused import get_language from aider/linter.py.
# Aider chat conversation:

USER: I ran this command:

 flake8 aider/linter.py

And got this output:

aider/linter.py:9:1: F401 'tree_sitter_languages.get_language' imported but unused

ASSISTANT: Please add the file `aider/linter.py` to the chat so I can make the necessary changes.

USER: I added these files to the chat: aider/linter.py

ASSISTANT: To resolve the flake8 warning, we need to remove the unused import `get_language` from `aider/linter.py`.

Here is the *SEARCH/REPLACE* block:

aider/linter.py
```python
<<<<<<< SEARCH
from tree_sitter_languages import get_language, get_parser  # noqa: E402
=======
from tree_sitter_languages import get_parser  # noqa: E402
>>>>>>> REPLACE
```
2024-05-17 14:30:58 -07:00
Paul Gauthier
a9fd02c74d aider: Remove unused imports and variable in aider/linter.py to pass pre-commit hooks.
# Aider chat conversation:

USER: I ran this command:

 .git/hooks/pre-commit

And got this output:

[WARNING] Unstaged files detected.
[INFO] Stashing unstaged files to /Users/gauthier/.cache/pre-commit/patch1715981257-12950.
isort....................................................................Failed
- hook id: isort
- files were modified by this hook

Fixing /Users/gauthier/Projects/aider/aider/linter.py

black....................................................................Failed
- hook id: black
- files were modified by this hook

reformatted aider/linter.py

All done!  🍰 
1 file reformatted.

flake8...................................................................Failed
- hook id: flake8
- exit code: 1

aider/linter.py:1:1: F401 'os' imported but unused
import os
^
aider/linter.py:6:1: F401 'tree_sitter' imported but unused
import tree_sitter
^
aider/linter.py:9:1: F401 'aider.dump.dump' imported but unused
from aider.dump import dump
^
aider/linter.py:21:5: F841 local variable 'language' is assigned to but never used
    language = get_language(lang)
    ^

[WARNING] Stashed changes conflicted with hook auto-fixes... Rolling back fixes...
[INFO] Restored changes from /Users/gauthier/.cache/pre-commit/patch1715981257-12950.

ASSISTANT: Please add `aider/linter.py` to the chat so I can make the necessary changes to fix the issues reported by the pre-commit hooks.

USER: I added these files to the chat: aider/linter.py

ASSISTANT: To fix the issues reported by the pre-commit hooks, we need to:

1. Remove unused imports: `os`, `tree_sitter`, and `dump`.
2. Remove the unused variable `language`.

Here are the *SEARCH/REPLACE* blocks:

aider/linter.py
```python
<<<<<<< SEARCH
import os
import sys
import warnings
from pathlib import Path

import tree_sitter
from grep_ast import TreeContext, filename_to_lang

from aider.dump import dump
=======
import sys
import warnings
from pathlib import Path

from grep_ast import TreeContext, filename_to_lang
>>>>>>> REPLACE
```

aider/linter.py
```python
<<<<<<< SEARCH
    language = get_language(lang)
=======
>>>>>>> REPLACE
```

Now, the file should pass the pre-commit hooks.
2024-05-17 14:27:54 -07:00
Paul Gauthier
494aa0140b Refactored the linter script to handle language detection and error traversal more efficiently. 2024-05-17 14:27:53 -07:00
Paul Gauthier
cb8a487c89 Display syntax errors with tree context 2024-05-17 14:22:25 -07:00
Paul Gauthier
86fdeb0597 aider: Update traverse_tree to print error type, line number, and 3 lines of context before/after the error.
# Aider chat conversation:

USER: print out the line and the N=3 lines before/after it

ASSISTANT: To print out the line with the error and the 3 lines before and after it, we need to modify the `traverse_tree` function in `aider/linter.py`. Here are the necessary changes:

aider/linter.py
```python
<<<<<<< SEARCH
    # Traverse the tree to find errors
=======
    # Traverse the tree to find errors and print context
>>>>>>> REPLACE
```

aider/linter.py
```python
<<<<<<< SEARCH
            print(f"{error_type} at line: {node.start_point[0] + 1}")
=======
            start_line = max(0, node.start_point[0] - 3)
            end_line = node.end_point[0] + 3
            error_line = node.start_point[0] + 1

            with open(file_path, 'r') as file:
                lines = file.readlines()

            print(f"{error_type} at line: {error_line}")
            print("Context:")
            for i in range(start_line, min(end_line, len(lines))):
                line_number = i + 1
                prefix = ">> " if line_number == error_line else "   "
                print(f"{prefix}{line_number}: {lines[i].rstrip()}")
            print("\n")
>>>>>>> REPLACE
```

This will ensure that the linter prints the error type, the line number, and the context of 3 lines before and after the error.
2024-05-17 14:00:59 -07:00
Paul Gauthier
0493680d57 aider: Update the linter to check for both 'ERROR' and 'MISSING' nodes.
# Aider chat conversation:

USER: is node.type 'ERROR" a standard across all tree sitter languages?

ASSISTANT: The `node.type == 'ERROR'` check is specific to the Tree-sitter library and is used to identify syntax errors in the parsed code. This is a standard feature across all languages supported by Tree-sitter.

Would you like to proceed with any changes or enhancements to the `aider/linter.py` file? If so, please specify the changes you need.

USER: is MISSING ever used to indicate a parsing/syntax problem

ASSISTANT: Yes, in Tree-sitter, `MISSING` is also used to indicate a parsing or syntax problem. Specifically, it indicates that a required element is missing in the syntax tree.

Would you like to update the `aider/linter.py` file to also check for `MISSING` nodes? If so, I can provide the necessary changes.

USER: yes

ASSISTANT: To update the `aider/linter.py` file to also check for `MISSING` nodes, we need to modify the `traverse_tree` function. Here are the necessary changes:

aider/linter.py
```python
<<<<<<< SEARCH
        if node.type == 'ERROR':
            print(f"Syntax error at line: {node.start_point[0] + 1}")
=======
        if node.type == 'ERROR' or node.is_missing:
            error_type = 'Syntax error' if node.type == 'ERROR' else 'Missing element'
            print(f"{error_type} at line: {node.start_point[0] + 1}")
>>>>>>> REPLACE
```

This change will ensure that the linter checks for both `ERROR` and `MISSING` nodes and reports them accordingly.
2024-05-17 14:00:42 -07:00
Paul Gauthier
c26833419d Fixed tree-sitter FutureWarning and refactored parsing logic in linter. 2024-05-17 14:00:41 -07:00
Paul Gauthier
3cc0a3c263 aider: Implemented function to parse file with tree-sitter and print syntax error line numbers.
# Aider chat conversation:

USER: write me a function that takes a file path and uses tree-sitter to parse the AST and print out the line number of every syntax/parse error in the file

ASSISTANT: To implement the function that takes a file path, uses tree-sitter to parse the AST, and prints out the line number of every syntax/parse error in the file, we need to:

1. Install the `tree-sitter` library.
2. Write the function in `aider/linter.py`.

Here is the *SEARCH/REPLACE* block for `aider/linter.py`:

aider/linter.py
```python
<<<<<<< SEARCH
=======
import os
import tree_sitter

def parse_file_for_errors(file_path):
    """
    Parses the given file using tree-sitter and prints out the line number of every syntax/parse error.
    """
    # Load the language
    Language = tree_sitter.Language
    PARSER = tree_sitter.Parser()
    LANGUAGE = Language(os.path.join('build', 'my-languages.so'), 'python')
    PARSER.set_language(LANGUAGE)

    # Read the file content
    with open(file_path, 'r') as file:
        content = file.read()

    # Parse the content
    tree = PARSER.parse(bytes(content, "utf8"))

    # Traverse the tree to find errors
    def traverse_tree(node):
        if node.type == 'ERROR':
            print(f"Syntax error at line: {node.start_point[0] + 1}")
        for child in node.children:
            traverse_tree(child)

    traverse_tree(tree.root_node)
>>>>>>> REPLACE
```

This code will:
1. Load the `tree-sitter` library and set up the parser for Python.
2. Read the content of the file specified by `file_path`.
3. Parse the content and traverse the AST to find and print the line numbers of any syntax errors.

You can now run this function by calling `parse_file_for_errors('path/to/your/file.py')`.
2024-05-17 13:47:52 -07:00
Paul Gauthier
4e0f8765d9 copy 2024-05-17 13:15:07 -07:00
Paul Gauthier
30179c185d copy 2024-05-17 13:14:28 -07:00
Paul Gauthier
771bea1fa4 copy 2024-05-17 13:12:26 -07:00
Paul Gauthier
2eced6ce12 copy 2024-05-17 13:05:29 -07:00
Paul Gauthier
05375fe279 link directly to examples 2024-05-17 12:55:09 -07:00
Paul Gauthier
8a960083c7 updated chat transcript divs 2024-05-17 12:51:13 -07:00
paul-gauthier
014ec6365e
Update 2024-05-13-models-over-time.md 2024-05-16 19:51:21 -07:00
Paul Gauthier
07c5cae982 copy 2024-05-16 18:17:17 -07:00
Paul Gauthier
2cd2f5439a copy 2024-05-16 18:15:28 -07:00
Paul Gauthier
6331edd954 copy 2024-05-16 18:15:11 -07:00
Paul Gauthier
47eebdb716 copy 2024-05-16 18:12:24 -07:00
Paul Gauthier
8c0bfeb392 copy 2024-05-16 18:09:41 -07:00
Paul Gauthier
6fe67d1132 added blog 2024-05-16 18:06:04 -07:00
Paul Gauthier
74c0df8df8 svg 2024-05-15 11:54:00 -07:00
Paul Gauthier
590cbbddfd Added models over time to leaderboard page 2024-05-15 11:51:28 -07:00
Paul Gauthier
170d8ff6a8 Updated contributing 2024-05-15 11:47:29 -07:00