Paul Gauthier (aider)
|
def2d4bac9
|
style: Fix string formatting in problem stats
|
2024-12-19 15:50:14 -08:00 |
|
Paul Gauthier (aider)
|
250e2ab6aa
|
feat: Print never solved exercises with full path
|
2024-12-19 15:50:11 -08:00 |
|
Paul Gauthier
|
6185ddf76a
|
feat: Print never solved exercises and remove dumps
|
2024-12-19 15:50:10 -08:00 |
|
Paul Gauthier (aider)
|
dddf192e5a
|
fix: Check for testcase key in results
|
2024-12-19 15:49:16 -08:00 |
|
Paul Gauthier (aider)
|
2d32f77ed0
|
feat: Print list of exercises never solved by any model
|
2024-12-19 15:49:13 -08:00 |
|
Paul Gauthier
|
7eb7533d42
|
fix: Handle missing testcase in results and bad json
|
2024-12-19 15:49:12 -08:00 |
|
Paul Gauthier (aider)
|
bb711fe255
|
style: Run linter
|
2024-12-19 14:39:23 -08:00 |
|
Paul Gauthier (aider)
|
14a8759b82
|
feat: Disqualify exercises with >=4 parse errors
|
2024-12-19 14:39:18 -08:00 |
|
Paul Gauthier
|
5a0d4eff71
|
fix: Correctly handle zero hard set problems
|
2024-12-19 14:39:17 -08:00 |
|
Paul Gauthier
|
a915c60999
|
feat: Add pass_num to benchmark results, fix hard set percent
|
2024-12-18 13:36:37 -08:00 |
|
Paul Gauthier (aider)
|
6ddb8a7d88
|
feat: Add hard set problem counts by language
|
2024-12-18 13:18:31 -08:00 |
|
Paul Gauthier (aider)
|
50bb2cb1e6
|
feat: Add total column to unsolved problems table
|
2024-12-18 13:17:38 -08:00 |
|
Paul Gauthier (aider)
|
e1571dda9b
|
style: Run linter
|
2024-12-18 13:16:45 -08:00 |
|
Paul Gauthier (aider)
|
7410c6216c
|
feat: Count and display copied exercises per language
|
2024-12-18 13:16:41 -08:00 |
|
Paul Gauthier (aider)
|
8f84df44ab
|
style: Run linter
|
2024-12-18 13:16:08 -08:00 |
|
Paul Gauthier (aider)
|
82f21b6734
|
fix: Copy hard set problems by language and exercise
|
2024-12-18 13:16:04 -08:00 |
|
Paul Gauthier (aider)
|
892fd5a6ef
|
style: Run linter
|
2024-12-18 13:13:55 -08:00 |
|
Paul Gauthier (aider)
|
3069db0cfd
|
feat: Add --copy-hard-set switch to copy hard set problems
|
2024-12-18 13:13:51 -08:00 |
|
Paul Gauthier (aider)
|
b71c9d539e
|
feat: Calculate and display unsolved problem percentages by language
|
2024-12-18 13:11:20 -08:00 |
|
Paul Gauthier (aider)
|
78e643970d
|
style: Fix linting issues
|
2024-12-18 13:09:46 -08:00 |
|
Paul Gauthier (aider)
|
34da3dd3d7
|
feat: Show percent of unsolved problems per language
|
2024-12-18 13:09:42 -08:00 |
|
Paul Gauthier (aider)
|
817cb0d363
|
fix: Remove unused List, Optional imports
|
2024-12-18 13:09:13 -08:00 |
|
Paul Gauthier (aider)
|
01088e214c
|
style: Run linter on problem_stats.py
|
2024-12-18 13:08:51 -08:00 |
|
Paul Gauthier (aider)
|
3e4500f9fd
|
feat: Print hard set problem counts by language
|
2024-12-18 13:08:48 -08:00 |
|
Paul Gauthier
|
d4b62608a9
|
chore: Move HARD_SET_NUM definition
|
2024-12-18 13:08:47 -08:00 |
|
Paul Gauthier (aider)
|
e6bfc1c2fc
|
refactor: Use constant for hard set threshold
|
2024-12-18 13:06:03 -08:00 |
|
Paul Gauthier
|
051cabed69
|
style: Adjust model column width in problem stats
|
2024-12-18 13:06:02 -08:00 |
|
Paul Gauthier (aider)
|
04916a6e97
|
style: Run linter on problem_stats.py
|
2024-12-18 13:03:31 -08:00 |
|
Paul Gauthier (aider)
|
f3be2fa66b
|
feat: Add hard set analysis to problem_stats.py
|
2024-12-18 13:03:27 -08:00 |
|
Paul Gauthier (aider)
|
c36087cc0c
|
style: Apply linter formatting
|
2024-12-18 12:55:47 -08:00 |
|
Paul Gauthier (aider)
|
e35909ac7d
|
refactor: Subsort exercises by name when solve rates are equal
|
2024-12-18 12:55:43 -08:00 |
|
Paul Gauthier
|
e5a693ab94
|
fix: Correctly format testcase/language in stats
|
2024-12-18 12:55:42 -08:00 |
|
Paul Gauthier (aider)
|
9e9cfb4600
|
fix: Calculate max name length after cleaning paths
|
2024-12-18 12:49:23 -08:00 |
|
Paul Gauthier (aider)
|
5dddaac006
|
style: Fix linting issues in problem_stats.py
|
2024-12-18 12:48:44 -08:00 |
|
Paul Gauthier (aider)
|
14af6f1fba
|
fix: Remove duplicate language prefix in problem stats
|
2024-12-18 12:48:40 -08:00 |
|
Paul Gauthier (aider)
|
e88064fdc9
|
style: Run linter
|
2024-12-18 12:47:17 -08:00 |
|
Paul Gauthier (aider)
|
6badf5ea1d
|
feat: Add cumulative sum column to distribution table
|
2024-12-18 12:47:14 -08:00 |
|
Paul Gauthier
|
20f5f3da24
|
chore: Remove unused import
|
2024-12-18 12:47:13 -08:00 |
|
Paul Gauthier (aider)
|
8c1b147705
|
style: Fix string formatting in problem stats
|
2024-12-18 12:46:02 -08:00 |
|
Paul Gauthier (aider)
|
366155b828
|
fix: Correct language lookup in problem_stats.py
|
2024-12-18 12:45:58 -08:00 |
|
Paul Gauthier (aider)
|
2c7d1897eb
|
style: Fix linting issues in problem_stats.py
|
2024-12-18 12:43:08 -08:00 |
|
Paul Gauthier (aider)
|
26ccb23402
|
feat: Add table showing exercise solution distribution
|
2024-12-18 12:43:04 -08:00 |
|
Paul Gauthier
|
d9e2471fcd
|
refactor: Remove unused dump calls in benchmark script
|
2024-12-18 12:43:03 -08:00 |
|
Paul Gauthier (aider)
|
8302b351dd
|
style: Fix line length in problem_stats.py
|
2024-12-18 12:38:45 -08:00 |
|
Paul Gauthier (aider)
|
b8647c0481
|
feat: Show exercises solved by all and total breakdown
|
2024-12-18 12:38:41 -08:00 |
|
Paul Gauthier
|
a168403d68
|
fix: Correctly extract language and testcase from results
|
2024-12-18 12:38:40 -08:00 |
|
Paul Gauthier (aider)
|
42d8650058
|
fix: Remove "exercises/" prefix from testcase output
|
2024-12-18 12:33:41 -08:00 |
|
Paul Gauthier (aider)
|
7ad0d46c11
|
style: Format problem_stats.py with linter
|
2024-12-18 12:31:54 -08:00 |
|
Paul Gauthier (aider)
|
58812f7f1f
|
refactor: Sort all exercises by solve rate, not by language
|
2024-12-18 12:31:50 -08:00 |
|
Paul Gauthier (aider)
|
65133b2aef
|
fix: Handle missing testcase key in problem stats
|
2024-12-18 12:29:38 -08:00 |
|