LocalAI/core
Brandon Beiler 6a6e1a0ea9
feat(vllm): Additional vLLM config options (Disable logging, dtype, and Per-Prompt media limits) (#4855)
* Adding the following vLLM config options: disable_log_status, dtype, limit_mm_per_prompt

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>

* using " marks in the config.yaml file

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>

* adding in missing colon

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>

---------

Signed-off-by: TheDropZone <brandonbeiler@gmail.com>
2025-02-18 19:27:58 +01:00
..
application feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00
backend feat(vllm): Additional vLLM config options (Disable logging, dtype, and Per-Prompt media limits) (#4855) 2025-02-18 19:27:58 +01:00
cli feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00
clients feat(store): add Golang client (#1977) 2024-04-16 15:54:14 +02:00
config feat(vllm): Additional vLLM config options (Disable logging, dtype, and Per-Prompt media limits) (#4855) 2025-02-18 19:27:58 +01:00
dependencies_manager fix: be consistent in downloading files, check for scanner errors (#3108) 2024-08-02 20:06:25 +02:00
explorer feat(explorer): make possible to run sync in a separate process (#3224) 2024-08-12 19:25:44 +02:00
gallery fix(gallery): do not return overrides and additional config (#4768) 2025-02-05 18:37:09 +01:00
http feat(ui): detect model usage and display link (#4864) 2025-02-18 19:27:07 +01:00
p2p fix(p2p): parse maddr correctly (#4219) 2024-11-21 14:06:49 +01:00
schema feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00
services feat: Centralized Request Processing middleware (#3847) 2025-02-10 12:06:16 +01:00