LocalAI/core/backend
Brandon Beiler 6a6e1a0ea9
feat(vllm): Additional vLLM config options (Disable logging, dtype, and Per-Prompt media limits) (#4855)
* Adding the following vLLM config options: disable_log_status, dtype, limit_mm_per_prompt

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>

* using " marks in the config.yaml file

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>

* adding in missing colon

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>

---------

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>
2025-02-18 19:27:58 +01:00
..
backend_suite_test.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
embeddings.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
image.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
llm.go feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00
llm_test.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
options.go feat(vllm): Additional vLLM config options (Disable logging, dtype, and Per-Prompt media limits) (#4855) 2025-02-18 19:27:58 +01:00
rerank.go feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00
soundgeneration.go feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00
stores.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
token_metrics.go chore(refactor): drop unnecessary code in loader (#4096) 2024-11-08 21:54:25 +01:00
tokenize.go feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00
transcript.go feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00
tts.go feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00
vad.go feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00