4003 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Ettore Di Giacinto	f8fbfd4fa3	chore(model gallery): add a-m-team_am-thinking-v1 (#5395) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-19 17:31:38 +02:00
Ettore Di Giacinto	41e239c67e	chore(model gallery): add soob3123_grayline-qwen3-8b (#5394) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-19 17:02:43 +02:00
Ettore Di Giacinto	587827e779	chore(model gallery): add soob3123_grayline-qwen3-14b (#5393) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-19 15:59:07 +02:00
LocalAI [bot]	456b4982ef	chore: ⬆️ Update ggml-org/llama.cpp to 6a2bc8bfb7cd502e5ebc72e36c97a6f848c21c2c (#5390) ... ⬆️ Update ggml-org/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-19 01:25:22 +00:00
Ettore Di Giacinto	159388cce8	chore: memoize detected GPUs (#5385) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-18 08:55:44 +02:00
LocalAI [bot]	cfc73c7773	chore: ⬆️ Update ggml-org/llama.cpp to e3a7cf6c5bf6a0a24217f88607b06e4405a2b5d9 (#5384) ... ⬆️ Update ggml-org/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-18 01:21:13 +00:00
Ettore Di Giacinto	6d5bde860b	feat(llama.cpp): upgrade and use libmtmd (#5379) ... * WIP * wip * wip * Make it compile * Update json.hpp * this shouldn't be private for now * Add logs * Reset auto detected template Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Re-enable grammars * This seems to be broken - 360a9c98e1 (diff-a18a8e64e12a01167d8e98fc)[…]cccf0d4eed09d76d879L2998-L3207 Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Placeholder * Simplify image loading * use completion type * disable streaming Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * correctly return timings Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Remove some debug logging * Adapt tests Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Keep header * embedding: do not use oai type Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Sync from server.cpp * Use utils and json directly from llama.cpp Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Sync with upstream Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix: copy json.hpp from the correct location Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * fix: add httplib * sync llama.cpp Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Embeddiongs: set OAICOMPAT_TYPE_EMBEDDING Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * feat: sync with server.cpp by including it Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * make it darwin-compatible Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-17 16:02:53 +02:00
LocalAI [bot]	6ef383033b	chore: ⬆️ Update ggml-org/whisper.cpp to d1f114da61b1ae1e70b03104fad42c9dd666feeb (#5381) ... ⬆️ Update ggml-org/whisper.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-17 00:35:17 +00:00
Richard Palethorpe	cd494089d9	fix(flux): Set CFG=1 so that prompts are followed (#5378) ... The recommendation with Flux is to set CFG to 1 as shown in the stablediffusion-cpp README. Signed-off-by: Richard Palethorpe <io@richiejp.com>	2025-05-16 17:53:54 +02:00
LocalAI [bot]	3033845f94	chore: ⬆️ Update ggml-org/whisper.cpp to 20a20decd94badfd519a07ea91f0bba8b8fc4dea (#5374) ... ⬆️ Update ggml-org/whisper.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-16 12:46:16 +02:00
omahs	0f365ac204	fix: typos (#5376) ... Signed-off-by: omahs <73983677+omahs@users.noreply.github.com>	2025-05-16 12:45:48 +02:00
Ettore Di Giacinto	525cf198be	chore(model gallery): add primeintellect_intellect-2 (#5373) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-15 10:53:52 +02:00
Ettore Di Giacinto	658c2a4f55	chore(model gallery): add thedrummer_rivermind-lux-12b-v1 (#5372) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-15 10:51:55 +02:00
Ettore Di Giacinto	c987de090d	chore(model gallery): add thedrummer_snowpiercer-15b-v1 (#5371) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-15 10:04:44 +02:00
Ettore Di Giacinto	04365843e6	chore(model gallery): add skywork_skywork-or1-7b (#5370) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-15 10:02:07 +02:00
Ettore Di Giacinto	1dc5781679	chore(model gallery): add skywork_skywork-or1-32b (#5369) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-15 09:58:51 +02:00
LocalAI [bot]	30704292de	chore: ⬆️ Update ggml-org/whisper.cpp to f389d7e3e56bbbfec49fd333551927a0fcbb7213 (#5367) ... ⬆️ Update ggml-org/whisper.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-15 00:34:16 +00:00
Ettore Di Giacinto	e52c66c76e	chore(docs/install.sh): image changes (#5354) ... chore(docs): image changes Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-14 19:28:30 +02:00
LocalAI [bot]	cb28aef93b	chore: ⬆️ Update ggml-org/whisper.cpp to f89056057511a1657af90bb28ef3f21e5b1f33cd (#5364) ... ⬆️ Update ggml-org/whisper.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-14 09:24:16 +02:00
LocalAI [bot]	029f97c2a2	docs: ⬆️ update docs version mudler/LocalAI (#5363) ... ⬆️ Update docs version mudler/LocalAI Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-14 01:54:34 +00:00
Ettore Di Giacinto	3be71be696	fix(ci): tag latest against cpu-only image (#5362) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-13 22:00:41 +02:00
LocalAI [bot]	6adb019f8f	chore: ⬆️ Update ggml-org/llama.cpp to de4c07f93783a1a96456a44dc16b9db538ee1618 (#5358) ... ⬆️ Update ggml-org/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-13 22:00:19 +02:00
LocalAI [bot]	fcaa0a2f01	chore: ⬆️ Update ggml-org/whisper.cpp to e41bc5c61ae66af6be2bd7011769bb821a83e8ae (#5357) ... ⬆️ Update ggml-org/whisper.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-13 21:59:50 +02:00
dependabot[bot]	fd17a3312c	chore(deps): bump securego/gosec from 2.22.3 to 2.22.4 (#5356) ... Bumps [securego/gosec](https://github.com/securego/gosec) from 2.22.3 to 2.22.4. - [Release notes](https://github.com/securego/gosec/releases) - [Changelog](https://github.com/securego/gosec/blob/master/.goreleaser.yml) - [Commits](https://github.com/securego/gosec/compare/v2.22.3...v2.22.4) --- updated-dependencies: - dependency-name: securego/gosec dependency-version: 2.22.4 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2025-05-12 22:01:43 +02:00
dependabot[bot]	12d0fe610b	chore(deps): bump dependabot/fetch-metadata from 2.3.0 to 2.4.0 (#5355) ... Bumps [dependabot/fetch-metadata](https://github.com/dependabot/fetch-metadata) from 2.3.0 to 2.4.0. - [Release notes](https://github.com/dependabot/fetch-metadata/releases) - [Commits](https://github.com/dependabot/fetch-metadata/compare/v2.3.0...v2.4.0) --- updated-dependencies: - dependency-name: dependabot/fetch-metadata dependency-version: 2.4.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2025-05-12 22:01:19 +02:00
Ettore Di Giacinto	11c67d16b8	chore(ci): strip 'core' in the image suffix, identify python-based images with 'extras' (#5353) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-12 09:36:59 +02:00
LocalAI [bot]	63f7c86c4d	chore: ⬆️ Update ggml-org/llama.cpp to 9a390c4829cd3058d26a2e2c09d16e3fd12bf1b1 (#5351) ... ⬆️ Update ggml-org/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-12 09:24:54 +02:00
LocalAI [bot]	ac89bf77bf	chore: ⬆️ Update ggml-org/whisper.cpp to 2e310b841e0b4e7cf00890b53411dd9f8578f243 (#4785) ... ⬆️ Update ggml-org/whisper.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-12 01:30:35 +00:00
Ettore Di Giacinto	0395cc02fb	chore(model gallery): add qwen_qwen2.5-vl-72b-instruct (#5349) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-11 09:46:32 +02:00
Ettore Di Giacinto	616972fca0	chore(model gallery): add qwen_qwen2.5-vl-7b-instruct (#5348) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-11 09:44:58 +02:00
Ettore Di Giacinto	942fbff62d	chore(model gallery): add gryphe_pantheon-proto-rp-1.8-30b-a3b (#5347) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-11 09:39:28 +02:00
LocalAI [bot]	2612a0c910	chore: ⬆️ Update ggml-org/llama.cpp to 15e6125a397f6086c1dfdf7584acdb7c730313dc (#5345) ... ⬆️ Update ggml-org/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-11 09:21:46 +02:00
LocalAI [bot]	2dcb6d7247	chore(model-gallery): ⬆️ update checksum (#5346) ... ⬆️ Checksum updates in gallery/index.yaml Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-10 22:24:04 +02:00
Ettore Di Giacinto	6978eec69f	feat(whisper.cpp): gpu support (#5344) ... * fix(whisper.cpp): gpu support Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Try to fix apple tests Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-10 22:02:40 +02:00
LocalAI [bot]	2fcfe54466	chore: ⬆️ Update ggml-org/llama.cpp to 33eff4024084d1f0c8441b79f7208a52fad79858 (#5343) ... ⬆️ Update ggml-org/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-10 10:07:39 +02:00
Ettore Di Giacinto	4e7506a3be	fix(whisper): add vulkan flag ... Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>	2025-05-10 08:46:21 +02:00
Ettore Di Giacinto	2a46217f90	Update Makefile ... Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>	2025-05-09 23:17:18 +02:00
Ettore Di Giacinto	31ff9dbd52	chore(Makefile): small cleanups, disable openmp on whisper ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-09 22:37:18 +02:00
Ettore Di Giacinto	9483abef03	fix(whisper/sycl): disable ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-09 22:36:09 +02:00
Ettore Di Giacinto	ce3e8b3e31	fix(whisper/sycl): use icx when running go build ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-09 21:48:09 +02:00
Ettore Di Giacinto	f3bb84c9a7	feat(whisper): link vulkan, hipblas and sycl ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-09 19:25:26 +02:00
Ettore Di Giacinto	ecb1297582	fix: specify icx and icpx only on whisper.cpp ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-09 10:58:30 +02:00
Ettore Di Giacinto	73fc702b3c	fix: this is not needed ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-09 10:28:53 +02:00
Ettore Di Giacinto	e3af62ae1a	feat: Add sycl support for whisper.cpp (#5341)	2025-05-09 09:31:02 +02:00
Ettore Di Giacinto	dc21604741	chore(deps): bump whisper.cpp (#5338) ... * chore(deps): bump whisper.cpp Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * add libggml-metal Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * Fixups macOS arm64 Signed-off-by: Ettore Di Giacinto <mudler@localai.io> * adjust cublas for whisper.cpp Signed-off-by: Ettore Di Giacinto <mudler@localai.io> --------- Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-09 08:17:45 +02:00
LocalAI [bot]	5433f1a70e	chore: ⬆️ Update ggml-org/llama.cpp to f05a6d71a0f3dbf0730b56a1abbad41c0f42e63d (#5340) ... ⬆️ Update ggml-org/llama.cpp Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>	2025-05-08 23:13:28 +00:00
Ettore Di Giacinto	d5e032bdcd	chore(model gallery): add gemma-3-12b-fornaxv.2-qat-cot (#5337) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-08 12:07:25 +02:00
Ettore Di Giacinto	de786f6586	chore(model gallery): add symiotic-14b-i1 (#5336) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-08 12:03:35 +02:00
Ettore Di Giacinto	8b9bc4aa6e	chore(model gallery): add qwen3-14b-uncensored (#5335) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-08 11:59:26 +02:00
Ettore Di Giacinto	e6cea7d28e	chore(model gallery): add cognition-ai_kevin-32b (#5334) ... Signed-off-by: Ettore Di Giacinto <mudler@localai.io>	2025-05-08 11:57:12 +02:00