Ettore Di Giacinto
f3ae94ca70
chore: update Image generation docs and examples ( #4841 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-02-17 16:51:06 +01:00
Ettore Di Giacinto
7f62b418a4
chore(docs): add documentation for l4t images
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-01-29 15:16:07 +01:00
Gianluca Boiano
032a33de49
chore: remove deprecated tinydream backend ( #4631 )
...
Signed-off-by: Gianluca Boiano <morf3089@gmail.com>
2025-01-18 18:35:30 +01:00
Ettore Di Giacinto
ab344e4f47
docs: update compatibility-table.md ( #4557 )
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2025-01-07 21:20:44 +01:00
Ettore Di Giacinto
cab9f88ca4
chore(docs): add nvidia l4t instructions ( #4454 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-12-23 18:59:33 +01:00
Ettore Di Giacinto
3127cd1352
chore(docs): update available backends ( #4325 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-12-05 16:57:56 +01:00
Ettore Di Giacinto
9475a6fa05
chore: drop petals ( #3316 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-08-20 10:01:38 +02:00
Ettore Di Giacinto
faadabea14
Update binaries.md
...
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
2024-08-14 10:08:32 +02:00
Ettore Di Giacinto
9a7ad75bff
docs: update to include installer and update advanced YAML options ( #2631 )
...
* docs: update quickstart and advanced sections
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* docs: improvements
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* examples(kubernete): add nvidia example
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-06-22 12:00:38 +02:00
fakezeta
169d8d21ff
gallery: Added some OpenVINO models ( #2249 )
...
* Added some OpenVINO models
Added Phi-3 trust_remote_code: true
Added Hermes 2 Pro Llama3
Added Multilingual-E5-base embedding model with OpenVINO acceleration (CPU and XPU)
Added all-MiniLM-L6-v2 with OpenVINO acceleration (CPU and XPU)
* Added Remote Code for phi, fixed error on Yamllint
* update openvino.yaml
I need to go to rest: today is not my day...
2024-05-06 10:52:05 +02:00
Ettore Di Giacinto
a24cd4fda0
docs: enhance and condense few sections ( #2178 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-04-28 23:41:59 +02:00
Ettore Di Giacinto
5e243ceaeb
docs: update gallery, add rerankers ( #2166 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-04-28 15:54:15 +02:00
jtwolfe
729378ca98
AMD/ROCm Documentation update + formatting fix ( #2100 )
...
* Update aio-images.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
* Update aio-images.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
* Update aio-images.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
* Update GPU-acceleration.md
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
---------
Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
2024-04-22 15:47:51 +02:00
Ettore Di Giacinto
eab4a91a9b
fix(aio): correctly detect intel systems ( #1931 )
...
Also rename SIZE to PROFILE
2024-03-30 12:04:32 +01:00
Ettore Di Giacinto
13ccd2afef
docs(aio-usage): update docs to show examples ( #1921 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-03-28 18:16:58 +01:00
Ettore Di Giacinto
e58410fa99
feat(aio): add intel profile ( #1901 )
...
* feat(aio): add intel profile
* docs: clarify AIO images features
2024-03-26 18:45:25 +01:00
Ettore Di Giacinto
c9adc5680c
fix(aio): make image-gen for GPU functional, update docs ( #1895 )
...
* readme: update quickstart
* aio(gpu): fix dreamshaper
* tests(aio): allow to run tests also against an endpoint
* docs: split content
* tests: less verbosity
---------
Co-authored-by: Dave <dave@gray101.com>
2024-03-25 21:04:32 +00:00
Ettore Di Giacinto
98ad93d53e
Drop ggml-based gpt2 and starcoder (supported by llama.cpp) ( #1679 )
...
* Drop ggml-based gpt2 and starcoder (supported by llama.cpp)
* Update compatibility table
2024-02-04 13:15:51 +01:00
Ettore Di Giacinto
df13ba655c
Drop old falcon backend (deprecated) ( #1675 )
...
Drop old falcon backend
2024-02-03 13:01:13 +01:00
Ettore Di Giacinto
1c57f8d077
feat(sycl): Add support for Intel GPUs with sycl ( #1647 ) ( #1660 )
...
* feat(sycl): Add sycl support (#1647 )
* onekit: install without prompts
* set cmake args only in grpc-server
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* cleanup
* fixup sycl source env
* Cleanup docs
* ci: runs on self-hosted
* fix typo
* bump llama.cpp
* llama.cpp: update server
* adapt to upstream changes
* adapt to upstream changes
* docs: add sycl
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-02-01 19:21:52 +01:00
Ettore Di Giacinto
ee42c9bfe6
docs: re-use original permalinks ( #1610 )
...
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-01-19 19:23:58 +01:00
Ettore Di Giacinto
6ca4d38a01
docs/examples: enhancements ( #1572 )
...
* docs: re-order sections
* fix references
* Add mixtral-instruct, tinyllama-chat, dolphin-2.5-mixtral-8x7b
* Fix link
* Minor corrections
* fix: models is a StringSlice, not a String
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
* WIP: switch docs theme
* content
* Fix GH link
* enhancements
* enhancements
* Fixed how to link
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
* fixups
* logo fix
* more fixups
* final touches
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
2024-01-18 19:41:08 +01:00