dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-17 16:25:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 23

feat(aio): add intel profile (#1901)

Browse source 
* feat(aio): add intel profile

* docs: clarify AIO images features
This commit is contained in:
Ettore Di Giacinto 2024-03-26 18:45:25 +01:00 • committed by GitHub
parent 1395e505cd
commit e58410fa99
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
16 changed files with 178 additions and 23 deletions
Download patch file Download diff file Expand all files Collapse all files

8
aio/cpu/embeddings.yaml
View file

@ -1,11 +1,5 @@
backend: bert-embeddings
embeddings: true
f16: true
gpu_layers: 90
mmap: true
name: text-embedding-ada-002
backend: bert-embeddings
parameters:
model: huggingface://mudler/all-MiniLM-L6-v2/ggml-model-q4_0.bin