dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-20 10:35:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 21

wip reranking llama.cpp

Browse source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2025-03-07 19:30:34 +01:00
parent 61cc76c455
commit 01e2e3dbc3
2 changed files with 61 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

1
backend/cpp/llama/utils.hpp vendored
View file

@ -61,6 +61,7 @@ struct task_server {
json data;
bool infill_mode = false;
bool embedding_mode = false;
bool reranking_mode = false;
int multitask_id = -1;
};