mirror of
https://github.com/mudler/LocalAI.git
synced 2025-05-20 10:35:01 +00:00
deps(conda): use transformers-env with vllm,exllama(2) (#1554)
* deps(conda): use transformers with vllm * join vllm, exllama, exllama2, split petals
This commit is contained in:
parent
ce724a7e55
commit
949da7792d
15 changed files with 40 additions and 131 deletions
|
@ -3,7 +3,7 @@
|
|||
## A bash script wrapper that runs the transformers server with conda
|
||||
|
||||
# Activate conda environment
|
||||
source activate vllm
|
||||
source activate transformers
|
||||
|
||||
# get the directory where the bash script is located
|
||||
DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" >/dev/null 2>&1 && pwd )"
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue