feat(transformers): add embeddings with Automodel (#1308)

Browse source

* Update huggingface.py

Switch SentenceTransformer for AutoModel in order to set trust_remote_code needed to use the encode method with embeddings models like jinai-v2

Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu>

* feat(transformers): split in separate backend

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Lucas Hänke de Cansino <lhc@next-boss.eu>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Lucas Hänke de Cansino <lhc@next-boss.eu>

...

This commit is contained in:

Ettore Di Giacinto 2023-11-20 21:21:17 +01:00 • committed by GitHub

parent ff9afdb0fe

commit 92cbc4d516

No known key found for this signature in database

GPG key ID: 4AEE18F83AFDEB23

23 changed files with 783 additions and 34 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

61

backend/python/transformers/backend_pb2.py Normal file

View file

File diff suppressed because one or more lines are too long