294 commits

Author	SHA1	Message	Date
Ettore Di Giacinto	dc6663d121	fix(template): we do not always have .Name (#5508) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-27 18:44:24 +02:00
Ettore Di Giacinto	090f5065fc	chore(deps): bump llama.cpp to 'fef693dc6b959a8e8ba11558fbeaad0b264dd457' (#5467) ... Also try to use a smaller model for integration tests Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-26 17:19:46 +02:00
Ettore Di Giacinto	88de2ea01a	feat(llama.cpp): add support for audio input (#5466) ... * feat(llama.cpp): add support for audio input Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Adapt tests Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-26 16:06:03 +02:00
Richard Palethorpe	bf6426aef2	feat: Realtime API support reboot (#5392) ... * feat(realtime): Initial Realtime API implementation Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore: go mod tidy Signed-off-by: Richard Palethorpe <io@richiejp.com> * feat: Implement transcription only mode for realtime API Reduce the scope of the real time API for the initial realease and make transcription only mode functional. Signed-off-by: Richard Palethorpe <io@richiejp.com> * chore(build): Build backends on a separate layer to speed up core only changes Signed-off-by: Richard Palethorpe <io@richiejp.com> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Signed-off-by: Richard Palethorpe <io@richiejp.com> Co-authored-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-25 22:25:05 +02:00
Ettore Di Giacinto	3b0cf52f6a	feat(llama.cpp): add reranking (#5396) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-22 21:49:30 +02:00
Ettore Di Giacinto	04a3d8e5ac	feat(ui): add error page to display errors (#5418) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-20 12:17:27 +02:00
omahs	0f365ac204	fix: typos (#5376) ... Signed-off-by: omahs <73983677+omahs@users.noreply.github.com>	2025-05-16 12:45:48 +02:00
Ettore Di Giacinto	21bdfe5fa4	fix: use rice when embedding large binaries (#5309) ... * fix(embed): use go-rice for large backend assets Golang embed FS has a hard limit that we might exceed when providing many binary alternatives. Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * simplify golang deps Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(tests): switch to testcontainers and print logs Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(tests): do not build a test binary Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * small fixup Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-04 16:42:42 +02:00
Ettore Di Giacinto	72111c597d	fix(gpu): do not assume gpu being returned has node and mem (#5310) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-03 19:00:24 +02:00
Ettore Di Giacinto	b2f9fc870b	chore(defaults): enlarge defaults, drop gpu layers which is infered (#5308) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-03 18:44:51 +02:00
Ettore Di Giacinto	5c6cd50ed6	feat(llama.cpp): estimate vram usage (#5299) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-02 17:40:26 +02:00
Mohit Gaur	b6e3dc5f02	docs: update docs for DisableWebUI flag (#5256) ... Signed-off-by: Mohit Gaur <56885276+Mohit-Gaur@users.noreply.github.com>	2025-04-27 16:02:02 +02:00
Ettore Di Giacinto	2c9279a542	feat(video-gen): add endpoint for video generation (#5247) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-04-26 18:05:01 +02:00
Ettore Di Giacinto	9628860c0e	feat(llama.cpp/clip): inject gpu options if we detect GPUs (#5243) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-04-26 00:04:47 +02:00
Ettore Di Giacinto	61cc76c455	chore(autogptq): drop archived backend (#5214) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-04-19 15:52:29 +02:00
Florian Bachmann	a03b70010f	fix(talk): Talk interface sends content-type headers to chatgpt (#5200) ... Talk interface sends content-type headers to chatgpt Signed-off-by: baflo <834350+baflo@users.noreply.github.com>	2025-04-17 15:02:11 +02:00
Gianluca Boiano	f67e5dec68	fix: bark-cpp: assign FLAG_TTS to bark-cpp backend (#5186) ... Signed-off-by: Gianluca Boiano <morf3089@gmail.com>	2025-04-16 08:21:30 +02:00
Ettore Di Giacinto	4f239bac89	feat: rebrand - LocalAGI and LocalRecall joins the LocalAI stack family (#5159) ... * wip Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * docs Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Update lotusdocs and hugo Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * rephrasing Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fixups Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Latest fixups Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Adjust readme section Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-04-15 17:51:24 +02:00
Ettore Di Giacinto	710f624ecd	fix(webui): improve model display, do not block view (#5133) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-04-07 18:03:25 +02:00
Ettore Di Giacinto	2c425e9c69	feat(loader): enhance single active backend by treating as singleton (#5107) ... feat(loader): enhance single active backend by treating at singleton Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-04-01 20:58:11 +02:00
Ettore Di Giacinto	9c74d74f7b	feat(gguf): guess default context size from file (#5089) ... feat(gguf): guess default config file from files Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-03-29 14:42:14 +01:00
Ettore Di Giacinto	1331129485	fix(routes): do not gate generated artifacts via key (#4971) ... fix(routes): do not gate generated images via key We generate unique uris for images. Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-03-10 15:58:25 +01:00
Ettore Di Giacinto	67f7bffd18	chore(deps): update llama.cpp and sync with upstream changes (#4950) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-03-06 00:40:58 +01:00
Ettore Di Giacinto	de81b42b49	feat(ui): remove api key handling and small ui adjustments (#4948) ... * chore(ui): drop set api key button Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * chore(ui): shore in-progress installs in model view Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat(ui): improve text to image view Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-03-05 19:37:36 +01:00
Ettore Di Giacinto	6b46c52789	feat(ui): complete design overhaul (#4942) ... This PR changes entirely the UI look and feeling. It updates all sections and makes it also mobile-ready. Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-03-05 08:27:03 +01:00
Ettore Di Giacinto	a7b4001b75	feat: allow to specify a reply prefix (#4931) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-03-02 16:07:32 +01:00
Ettore Di Giacinto	755e4fb5f4	feat(ui): improvements to index and models page (#4918) ... - mobile-friendly index - adjust color palette - improve search experience Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-28 19:23:32 +01:00
Ettore Di Giacinto	6d0712fa6d	fix(ui): not all models comes from gallery (#4915) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-27 19:12:41 +01:00
Ettore Di Giacinto	bbbb28e3ca	fix(models): unify usecases identifications (#4914) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-27 15:51:12 +01:00
Ettore Di Giacinto	3bf2e9d065	fix(ui): not all models have an Icon (#4913) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-27 10:52:19 +01:00
Ettore Di Giacinto	c87870b18e	feat(ui): improve chat interface (#4910) ... * feat(ui): show more informations in the chat view, minor adjustments to model gallery Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix(ui): UI improvements Visual improvements and bugfixes including: - disable pagination during search - fix scrolling on new message Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-26 18:27:18 +01:00
Ettore Di Giacinto	5ad2be9c45	feat(ui): small improvements to chat interface (#4907) ... - Change chat colors - Improve layout on small windows Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-26 11:10:40 +01:00
Ettore Di Giacinto	e9971b168a	feat(ui): paginate model gallery (#4886) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-22 21:38:00 +01:00
Ettore Di Giacinto	25bee71bb8	feat(ui): do also filter tts and image models (#4871) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-20 15:02:18 +01:00
Ettore Di Giacinto	ea0c9f1168	feat(ui): show only text models in the chat interface (#4869) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-19 17:34:30 +01:00
Brandon Beiler	6a6e1a0ea9	feat(vllm): Additional vLLM config options (Disable logging, dtype, and Per-Prompt media limits) (#4855) ... * Adding the following vLLM config options: disable_log_status, dtype, limit_mm_per_prompt Signed-off-by: TheDropZone <brandonbeiler@gmail.com> * using " marks in the config.yaml file Signed-off-by: TheDropZone <brandonbeiler@gmail.com> * adding in missing colon Signed-off-by: TheDropZone <brandonbeiler@gmail.com> --------- Signed-off-by: TheDropZone <brandonbeiler@gmail.com>	2025-02-18 19:27:58 +01:00
Ettore Di Giacinto	5b19af99ff	feat(ui): detect model usage and display link (#4864) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-18 19:27:07 +01:00
Ettore Di Giacinto	bb85b6ef00	feat: improve ui models list in the index (#4863) ... * feat(ui): improve index - Redirect to the chat view when clicking on a model Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Display chat icon nearby the model Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-18 12:44:44 +01:00
Ettore Di Giacinto	09941c0bfb	chore(docs): update license year ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-15 18:17:15 +01:00
Ettore Di Giacinto	28b10e8804	chore(swagger): update (#4805) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-11 09:51:01 +01:00
Dave	3cddf24747	feat: Centralized Request Processing middleware (#3847) ... * squash past, centralize request middleware PR Signed-off-by: Dave Lee <dave@gray101.com> * migrate bruno request files to examples repo Signed-off-by: Dave Lee <dave@gray101.com> * fix Signed-off-by: Dave Lee <dave@gray101.com> * Update tests/e2e-aio/e2e_test.go Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> --------- Signed-off-by: Dave Lee <dave@gray101.com> Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>	2025-02-10 12:06:16 +01:00
Ettore Di Giacinto	cc1f6f913f	fix(llama.cpp): disable mirostat as default (#2911) ... Even if increasing the quality of the output, it has shown to have performance drawbacks to be so noticeable that the confuses users about speed of LocalAI ( see also https://github.com/mudler/LocalAI/issues/2780 ). This changeset disables Mirostat by default (which can be still enabled manually). Signed-off-by: Ettore Di Giacinto <mudler@localai.io> Co-authored-by: Dave <dave@gray101.com>	2025-02-06 19:39:59 +01:00
Ettore Di Giacinto	7f90ff7aec	chore(llama-ggml): drop deprecated backend (#4775) ... The GGML format is now dead, since in the next version of LocalAI we already bring many breaking compatibility changes, taking the occasion also to drop ggml support (pre-gguf). Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-06 18:36:23 +01:00
Ettore Di Giacinto	8d45670e41	fix(openai): consistently return stop reason (#4771) ... We were not returning a stop reason when no tool was actually called (even if specified). Fixes: https://github.com/mudler/LocalAI/issues/4716 Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-06 12:41:08 +01:00
Ettore Di Giacinto	7daf5ac3e3	fix(gallery): do not return overrides and additional config (#4768) ... When hitting /models/available we are intersted in the model description, name and small metadatas. Configuration and overrides are part of internals which are required only for installation. This also solves a current bug when hitting /models/available fails if one of the gallery items have overrides with parameters defined Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-05 18:37:09 +01:00
Shraddha	03974a4dd4	feat: tokenization with llama.cpp (#4724) ... feat: tokenization Signed-off-by: shraddhazpy <shraddha@shraddhafive.in>	2025-02-02 17:39:43 +00:00
Ettore Di Giacinto	1d6afbd65d	feat(llama.cpp): Add support to grammar triggers (#4733) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-02-02 13:25:03 +01:00
Ettore Di Giacinto	af41436f1b	fix(tests): pin to branch for config used in tests (#4721) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-31 09:57:58 +01:00
Ettore Di Giacinto	72e52c4f6a	chore: drop embedded models (#4715) ... Since the remote gallery was introduced this is now completely superseded by it. In order to keep the code clean and remove redudant parts let's simplify the usage. Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-01-30 00:03:01 +01:00
Peter Cover	a05737c7e4	chore: fix some function names in comment (#4665) ... Signed-off-by: petercover <raowanxiang@outlook.com>	2025-01-22 19:35:53 +01:00