dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-20 10:35:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 21

feat(l4t): add support for extras images

Browse source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2025-02-04 10:06:47 +01:00
parent 464686aee6
commit 27d7ada8dd
18 changed files with 88 additions and 11 deletions
Download patch file Download diff file Expand all files Collapse all files

1
backend/python/vllm/requirements-after.txt
View file

@ -1 +0,0 @@
vllm

3
backend/python/vllm/requirements-cpu.txt
View file

@ -1,3 +1,4 @@
accelerate
torch==2.4.1
transformers
transformers
vllm

3
backend/python/vllm/requirements-cublas11.txt
View file

@ -2,4 +2,5 @@
accelerate
torch==2.4.1+cu118
transformers
bitsandbytes
bitsandbytes
vllm

3
backend/python/vllm/requirements-cublas12.txt
View file

@ -1,4 +1,5 @@
accelerate
torch==2.4.1
transformers
bitsandbytes
bitsandbytes
vllm

3
backend/python/vllm/requirements-hipblas.txt
View file

@ -2,4 +2,5 @@
accelerate
torch==2.4.1+rocm6.0
transformers
bitsandbytes
bitsandbytes
vllm

3
backend/python/vllm/requirements-intel.txt
View file

@ -6,4 +6,5 @@ transformers
optimum[openvino]
setuptools
bitsandbytes
oneccl_bind_pt==2.3.100+xpu
oneccl_bind_pt==2.3.100+xpu
vllm

7
backend/python/vllm/requirements-l4t.txt Normal file
View file

@ -0,0 +1,7 @@
--index-url https://pypi.jetson-ai-lab.dev/jp6/cu126/
accelerate
torch
vllm
transformers
bitsandbytes
flash-attn