mirror of
https://github.com/mudler/LocalAI.git
synced 2025-05-20 10:35:01 +00:00
fix(python): move accelerate and GPU-specific libs to build-type (#3194)
Some of the dependencies in `requirements.txt`, even if generic, pulls down the line CUDA libraries. This changes moves mostly all GPU-specific libs to the build-type, and tries a safer approach. In `requirements.txt` now are listed only "first-level" dependencies, for instance, grpc, but libs-dependencies are moved down to the respective build-type `requirements.txt` to avoid any mixin. This should fix #2737 and #1592. Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
parent
abcf0ff000
commit
61b5602111
79 changed files with 212 additions and 61 deletions
1
backend/python/vllm/requirements-after.txt
Normal file
1
backend/python/vllm/requirements-after.txt
Normal file
|
@ -0,0 +1 @@
|
|||
flash-attn
|
4
backend/python/vllm/requirements-cpu.txt
Normal file
4
backend/python/vllm/requirements-cpu.txt
Normal file
|
@ -0,0 +1,4 @@
|
|||
accelerate
|
||||
torch
|
||||
transformers
|
||||
vllm
|
|
@ -1,3 +1,5 @@
|
|||
--extra-index-url https://download.pytorch.org/whl/cu118
|
||||
accelerate
|
||||
torch
|
||||
flash-attn
|
||||
transformers
|
||||
vllm
|
|
@ -1,2 +1,4 @@
|
|||
accelerate
|
||||
torch
|
||||
flash-attn
|
||||
transformers
|
||||
vllm
|
|
@ -1,2 +1,5 @@
|
|||
--extra-index-url https://download.pytorch.org/whl/rocm6.0
|
||||
torch
|
||||
accelerate
|
||||
torch
|
||||
transformers
|
||||
vllm
|
|
@ -1,5 +1,8 @@
|
|||
--extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
|
||||
intel-extension-for-pytorch
|
||||
accelerate
|
||||
torch
|
||||
transformers
|
||||
optimum[openvino]
|
||||
setuptools==70.3.0 # https://github.com/mudler/LocalAI/issues/2406
|
||||
setuptools==70.3.0 # https://github.com/mudler/LocalAI/issues/2406
|
||||
vllm
|
|
@ -1,7 +1,4 @@
|
|||
accelerate
|
||||
vllm
|
||||
grpcio==1.65.4
|
||||
protobuf
|
||||
certifi
|
||||
transformers
|
||||
setuptools
|
Loading…
Add table
Add a link
Reference in a new issue