LocalAI/backend
mintyleaf 96f8ec0402
feat: add machine tag and inference timings (#4577)
* Add machine tag option, add extraUsage option, grpc-server -> proto -> endpoint extraUsage data is broken for now

Signed-off-by: mintyleaf <mintyleafdev@gmail.com>

* remove redurant timing fields, fix not working timings output

Signed-off-by: mintyleaf <mintyleafdev@gmail.com>

* use middleware for Machine-Tag only if tag is specified

Signed-off-by: mintyleaf <mintyleafdev@gmail.com>

---------

Signed-off-by: mintyleaf <mintyleafdev@gmail.com>
2025-01-17 17:05:58 +01:00
..
cpp feat: add machine tag and inference timings (#4577) 2025-01-17 17:05:58 +01:00
go chore(stablediffusion-ggml): disable sycl optimizations (#4598) 2025-01-14 09:17:55 +01:00
python feat(transformers): merge musicgen functionalities to a single backend (#4620) 2025-01-17 17:01:16 +01:00
backend.proto feat: add machine tag and inference timings (#4577) 2025-01-17 17:05:58 +01:00