LocalAI/pkg
Ettore Di Giacinto c72808f18b
feat(tools): support Tool calls in the API (#1715)
* feat(tools): support Tools in the API

Co-authored-by: =?UTF-8?q?Stephan=20A=C3=9Fmus?= <stephan.assmus@sap.com>

* feat(tools): support function streaming

* Adhere to new return types when using tools instead of functions

* Keep backward compatibility with function calling

* Evaluate function names in chat templates

* Disable recovery with --debug

* Correctly stream out the entire result

* Detect when llm chooses to reply and to not perform any action in SSE

* Feedback from code review

---------

Co-authored-by: =?UTF-8?q?Stephan=20A=C3=9Fmus?= <stephan.assmus@sap.com>
2024-02-17 10:00:34 +01:00
..
assets feat: embedded model configurations, add popular model examples, refactoring (#1532) 2024-01-05 23:16:33 +01:00
downloader feat: embedded model configurations, add popular model examples, refactoring (#1532) 2024-01-05 23:16:33 +01:00
gallery feat: embedded model configurations, add popular model examples, refactoring (#1532) 2024-01-05 23:16:33 +01:00
grammar feat(tools): support Tool calls in the API (#1715) 2024-02-17 10:00:34 +01:00
grpc transformers: correctly load automodels (#1643) 2024-01-26 00:13:21 +01:00
langchain feat: add LangChainGo Huggingface backend (#446) 2023-06-01 12:00:06 +02:00
model feat(tools): support Tool calls in the API (#1715) 2024-02-17 10:00:34 +01:00
stablediffusion feat: support upscaled image generation with esrgan (#509) 2023-06-05 17:21:38 +02:00
startup feat(startup): fetch model definition remotely (#1654) 2024-01-28 00:14:16 +01:00
tinydream feat: add tiny dream stable diffusion support (#1283) 2023-12-24 19:27:24 +00:00
utils feat: embedded model configurations, add popular model examples, refactoring (#1532) 2024-01-05 23:16:33 +01:00