dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-21 19:15:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 13

feat: 🐍 add mamba support (#1589)

Browse source 
feat(mamba): Initial import

This is a first iteration of the mamba backend, loosely based on
mamba-chat(https://github.com/havenhq/mamba-chat).
This commit is contained in:
Ettore Di Giacinto 2024-01-19 23:42:50 +01:00 • committed by GitHub
parent 52c9a7f45d
commit 9e653d6abe
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
13 changed files with 762 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

21
backend/python/mamba/install.sh Normal file
View file

@ -0,0 +1,21 @@
#!/bin/bash
##
## A bash script installs the required dependencies of VALL-E-X and prepares the environment
export PATH=$PATH:/opt/conda/bin
if [ "$BUILD_TYPE" != "cublas" ]; then
echo "[mamba] Attention!!! nvcc is required - skipping installation"
exit 0
fi
# Activate conda environment
source activate transformers
echo $CONDA_PREFIX
pip install causal-conv1d==1.0.0 mamba-ssm==1.0.1
if [ "$PIP_CACHE_PURGE" = true ] ; then
pip cache purge
fi