dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-20 02:24:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 21
LocalAI/backend/python/vllm
History
Wyatt Neal 4076ea0494
fix: vllm missing logprobs (#5279) 
* working to address missing items

referencing #3436, #2930 - if i could test it, this might show that the
output from the vllm backend is processed and returned to the user

Signed-off-by: Wyatt Neal <wyatt.neal+git@gmail.com>

* adding in vllm tests to test-extras

Signed-off-by: Wyatt Neal <wyatt.neal+git@gmail.com>

* adding in tests to pipeline for execution

Signed-off-by: Wyatt Neal <wyatt.neal+git@gmail.com>

* removing todo block, test via pipeline

Signed-off-by: Wyatt Neal <wyatt.neal+git@gmail.com>

---------

Signed-off-by: Wyatt Neal <wyatt.neal+git@gmail.com>
2025-04-30 12:55:07 +00:00
..
backend.py fix: vllm missing logprobs (#5279) 2025-04-30 12:55:07 +00:00
install.sh chore(deps): bump grpcio to 1.68.1 (#4301) 2024-12-02 19:13:26 +01:00
Makefile feat: create bash library to handle install/run/test of python backends (#2286) 2024-05-11 18:32:46 +02:00
README.md refactor: move backends into the backends directory (#1279) 2023-11-13 22:40:16 +01:00
requirements-after.txt fix(python): move vllm to after deps, drop diffusers main deps 2024-08-07 23:34:37 +02:00
requirements-cpu.txt fix(dependencies): pin pytorch version (#3872) 2024-10-18 09:11:59 +02:00
requirements-cublas11-after.txt feat(venv): shared env (#3195) 2024-08-07 19:45:14 +02:00
requirements-cublas11.txt fix(dependencies): pin pytorch version (#3872) 2024-10-18 09:11:59 +02:00
requirements-cublas12-after.txt feat(venv): shared env (#3195) 2024-08-07 19:45:14 +02:00
requirements-cublas12.txt fix(dependencies): pin pytorch version (#3872) 2024-10-18 09:11:59 +02:00
requirements-hipblas.txt fix(dependencies): pin pytorch version (#3872) 2024-10-18 09:11:59 +02:00
requirements-install.txt feat: migrate python backends from conda to uv (#2215) 2024-05-10 15:08:08 +02:00
requirements-intel.txt fix(intel): pin torch and intel-extensions (#4435) 2024-12-19 15:39:32 +01:00
requirements.txt chore(deps): bump grpcio to 1.72.0 (#5244) 2025-04-25 21:32:37 +02:00
run.sh feat: create bash library to handle install/run/test of python backends (#2286) 2024-05-11 18:32:46 +02:00
test.py fix: vllm missing logprobs (#5279) 2025-04-30 12:55:07 +00:00
test.sh feat: create bash library to handle install/run/test of python backends (#2286) 2024-05-11 18:32:46 +02:00

README.md

Creating a separate environment for the vllm project

make vllm