dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-22 19:44:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 13

feat(transformers): add embeddings with Automodel (#1308)

Browse source 
* Update huggingface.py

Switch SentenceTransformer for AutoModel in order to set trust_remote_code needed to use the encode method with embeddings models like jinai-v2

Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu>

* feat(transformers): split in separate backend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Lucas Hänke de Cansino <lhc@next-boss.eu>
This commit is contained in:
Ettore Di Giacinto 2023-11-20 21:21:17 +01:00 • committed by GitHub
parent ff9afdb0fe
commit 92cbc4d516
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
23 changed files with 783 additions and 34 deletions
Download patch file Download diff file Expand all files Collapse all files

18
backend/python/transformers/Makefile Normal file
View file

@ -0,0 +1,18 @@
.PONY: transformers
transformers:
@echo "Creating virtual environment..."
@conda env create --name transformers --file transformers.yml
@echo "Virtual environment created."
.PONY: run
run:
@echo "Running transformers..."
bash run.sh
@echo "transformers run."
# It is not working well by using command line. It only6 works with IDE like VSCode.
.PONY: test
test:
@echo "Testing transformers..."
bash test.sh
@echo "transformers tested."