hypn4
6dc846d41b
fix: added missing parameters.
...
added missing parameters in `simple_send_with_retries` function.
2024-09-23 20:37:10 +09:00
hypn4
d0bce02c00
feat: add extra_body
field and use in model settings.
...
resolved : #1583
The `extra_body` field is a parameter used by the `openai` provider.
Since `litellm` also uses this field to additionally transmit `request body`, I added a function so that `aider` can also utilize the `extra_body` field.
The `openrouter` provider also supports various functions through the additional field of `request body`, so we added the function.
The following is how to use it in model settings.
```yaml
# .aider.model.settings.yml
- name: "openrouter/<YOUR_MODEL>"
edit_format: "whole"
use_repo_map: true
extra_body:
provider:
order:
- Azure
allow_fallbacks: false
```
2024-09-23 20:37:10 +09:00
Paul Gauthier
2ca093fb84
Bumping all dependencies
2024-09-21 11:04:57 -07:00
Paul Gauthier
1755d2e0f4
fix: Use temperature setting from model configuration
2024-09-12 14:24:21 -07:00
Paul Gauthier
291b456a45
hack for o1-mini: no system prompt, no temperature
2024-09-12 13:05:25 -07:00
Paul Gauthier
97a70830e9
cleanup
2024-08-26 15:49:48 -07:00
Paul Gauthier (aider)
2906dcb642
style: Fix formatting in sendchat.py
2024-08-23 14:20:18 -07:00
Paul Gauthier (aider)
5ded503d2b
fix: Only include extra_headers in send_completion if not None
2024-08-23 14:20:15 -07:00
Paul Gauthier (aider)
e81ddcc1a6
feat: Add extra_headers parameter to simple_send_with_retries
2024-08-23 14:17:44 -07:00
Paul Gauthier
3996c4a7d5
force tool use
2024-08-14 11:21:36 -07:00
Paul Gauthier
675263623d
use strict for new gpt4o
2024-08-14 11:14:37 -07:00
Paul Gauthier
e1b83ba6b5
Merge branch 'main' into json-coders
2024-08-13 17:03:30 -07:00
Paul Gauthier
2a1fb7d150
Clean up DEEPSEEK_API_BASE
2024-08-12 15:35:32 -07:00
Paul Gauthier (aider)
485418d917
feat: Add --deepseek-beta bool arg to use DeepSeek Coder via the beta API endpoint
2024-08-12 15:06:55 -07:00
Paul Gauthier (aider)
2669b0c758
style: Apply linter edits to sendchat.py
2024-08-12 15:04:08 -07:00
Paul Gauthier (aider)
7822c1c879
feat: Add support for DeepSeek API base URL
2024-08-12 15:04:05 -07:00
Paul Gauthier
3f6ae4b2d9
Handle retries at a higher level; exceptions come out of the streaming completion object
2024-08-08 14:54:59 -03:00
Paul Gauthier
3d66aea572
retry sends in most cases
2024-08-07 11:30:43 -03:00
Paul Gauthier
1ecc780f74
Revert "Stop using litellm._should_retry"
...
This reverts commit 1e232d4db6
.
2024-08-07 11:29:31 -03:00
Paul Gauthier
47295a1545
wip
2024-08-07 07:37:16 -03:00
Paul Gauthier
1e232d4db6
Stop using litellm._should_retry
2024-08-06 14:32:52 -03:00
Paul Gauthier
da3e507ec4
Revert "rename simple_send_with_retries -> send_with_retries"
...
This reverts commit d619edf6e9
.
2024-08-02 10:49:44 -03:00
Paul Gauthier
d619edf6e9
rename simple_send_with_retries -> send_with_retries
2024-08-02 10:35:10 -03:00
Paul Gauthier
4a42a07237
fix: Handle empty status codes in litellm retry decorator
2024-08-01 18:33:52 -03:00
Paul Gauthier
5e818c2899
support 8k output with 3.5 sonnet
2024-08-01 17:52:14 -03:00
Paul Gauthier (aider)
38b411a6cb
feat: Add extra_headers parameter to send_with_retries function
2024-08-01 17:27:31 -03:00
Paul Gauthier (aider)
bcd802b6e9
Add retry support for litellm.InternalServerError
in the send_with_retries
function in aider/sendchat.py
.
2024-07-30 12:23:41 -03:00
Paul Gauthier (aider)
cba53bfc22
Add retry support for litellm.InternalServerError
2024-07-30 12:23:33 -03:00
Paul Gauthier
9d02628cf8
streamlit borks sys.path, causes import("litellm") to load our litellm.py; fix
2024-07-03 21:32:50 -03:00
Paul Gauthier
2dc6735ab4
defer import of httpx
2024-07-03 13:25:10 -03:00
Paul Gauthier
ee203deef0
Lazily import litellm to shave >1sec off the initial load time of aider
2024-07-03 12:45:53 -03:00
Paul Gauthier
2cd680cba7
Automatically retry on Anthropic overloaded_error
2024-07-01 14:12:00 -03:00
Paul Gauthier
044617b1b7
continue roughly working using anthropic's prefill
2024-06-27 14:40:46 -07:00
Paul Gauthier
819fccc7a4
added temp param, prompt strong that files message is truth
2024-05-16 08:52:30 -07:00
Paul Gauthier
4841f318c1
always retry httpx errors
2024-05-11 15:01:56 -07:00
Paul Gauthier
1098b428e6
prompt tweaks, retry on httpx.ReadTimeout
2024-05-11 07:47:53 -07:00
Paul Gauthier
728a629789
Catch and appropriately retry *all* litellm exceptions #598
2024-05-09 14:16:09 -07:00
Paul Gauthier
9ff6770a04
refactored litellm to avoid duplicating workarounds
2024-05-08 08:05:15 -07:00
Paul Gauthier
3e4fca2675
max_time not max_tries
2024-05-04 17:48:01 -07:00
Paul Gauthier
7c9c4fe788
should_giveup?
2024-05-04 17:43:26 -07:00
Paul Gauthier
1d7320e8a0
Added httpx.RemoteProtocolError to backoff #586
2024-05-03 08:48:19 -07:00
Paul Gauthier
a3a4d87a0c
treat litellm.exceptions.BadRequestError as a 400 error and do not retry
2024-04-30 15:40:28 -07:00
Paul Gauthier
3469e04eb8
Do exp backoff for litellm.exceptions.ServiceUnavailableError #580
2024-04-30 15:34:01 -07:00
Paul Gauthier
7b14d77e9e
Don't retry on gemini RECITATION error
2024-04-30 14:40:15 -07:00
Paul Gauthier
01cf038bb5
Quiet litellm
2024-04-23 10:37:43 -07:00
Paul Gauthier
9afa6e8435
Added gemini 1.5 pro
2024-04-23 09:49:48 -07:00
Paul Gauthier
0da1b59901
Fixed up images in chat
2024-04-18 14:39:32 -07:00
Paul Gauthier
c770fc4380
cleaned up client refs
2024-04-17 15:47:07 -07:00
Paul Gauthier
b0245d3930
rouged in litellm
2024-04-17 14:15:24 -07:00
Joshua Vial
9ceaf97f08
making image code more robust
2023-12-11 22:25:35 +13:00