LocalAI/core/config
Ettore Di Giacinto cf747bcdec
feat: extract output with regexes from LLMs (#3491)
* feat: extract output with regexes from LLMs

This changset adds `extract_regex` to the LLM config. It is a list of
regexes that can match output and will be used to re extract text from
the LLM output. This is particularly useful for LLMs which outputs final
results into tags.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Add tests, enhance output in case of configuration error

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-09-13 13:27:36 +02:00
..
application_config.go chore: allow to disable gallery endpoints, improve p2p connection handling (#3256) 2024-08-17 08:28:52 +02:00
backend_config.go feat: extract output with regexes from LLMs (#3491) 2024-09-13 13:27:36 +02:00
backend_config_loader.go fix: be consistent in downloading files, check for scanner errors (#3108) 2024-08-02 20:06:25 +02:00
backend_config_test.go refactor: gallery inconsistencies (#2647) 2024-06-24 17:32:12 +02:00
config_suite_test.go dependencies(grpcio): bump to fix CI issues (#2362) 2024-05-21 14:33:47 +02:00
config_test.go feat(llama.cpp): guess model defaults from file (#2522) 2024-06-08 22:13:02 +02:00
gallery.go refactor: gallery inconsistencies (#2647) 2024-06-24 17:32:12 +02:00
guesser.go feat(guesser): add gemma2 (#3118) 2024-08-04 09:45:42 +02:00