dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-20 02:24:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 21

Embeddiongs: set OAICOMPAT_TYPE_EMBEDDING

Browse source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2025-05-17 08:33:08 +02:00
parent bad6d96a2b
commit 66341857c9
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
backend/cpp/llama/grpc-server.cpp
View file

@ -4302,7 +4302,7 @@ public:
task.prompt_tokens = server_tokens(tokenized_prompts[i], ctx_server.mctx != nullptr);
// OAI-compat
task.params.oaicompat = OAICOMPAT_TYPE_NONE;
task.params.oaicompat = OAICOMPAT_TYPE_EMBEDDING;
tasks.push_back(std::move(task));
}