dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-28 05:35:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 22
2626 commits 61 branches 116 tags 60 MiB
Commit graph

2626 commits

This branch
This branch
All branches
Author SHA1 Message Date
Ettore Di Giacinto
0ee1f8c1cf
ci(Makefile): enable p2p on cross-arm64 builds (#2928) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-20 10:43:34 +02:00
Ettore Di Giacinto
87bd831aba
docs: add federation (#2929) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-20 10:43:18 +02:00
Ettore Di Giacinto
f9f83791d1
ci(release): run also on tags 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-20 09:15:48 +02:00
LocalAI [bot]
e75f73bf73
chore: ⬆️ Update ggerganov/llama.cpp (#2927) 
⬆️ Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-19 22:10:26 +00:00
LocalAI [bot]
bd277162c7
docs: ⬆️ update docs version mudler/LocalAI (#2926) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-19 21:56:58 +00:00
Dave
3ac4fe181a
Merge branch 'master' into default_miro 2024-07-19 14:41:39 -04:00
Ettore Di Giacinto
f19ee465d2
ci: disable comment-pr until it's fixed 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-19 19:00:36 +02:00
Ettore Di Giacinto
7b85ff7280
models(gallery): add celestev1 (#2925) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 18:43:30 +02:00
Ettore Di Giacinto
134cb993c2
models(gallery): add emo-2b (#2924) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 18:36:11 +02:00
Ettore Di Giacinto
2cf28f3c01
models(gallery): add gemma-2b-translation-v0.150 (#2923) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 18:31:27 +02:00
Ettore Di Giacinto
18c0f4718d
models(gallery): add einstein-v4-7b (#2922) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 15:20:15 +02:00
Ettore Di Giacinto
f878b63ee4
models(gallery): add qwen2-wukong-7b (#2921) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 09:48:05 +02:00
Ettore Di Giacinto
6eaa01db15
models(gallery): add phillama-3.8b-v0.1 (#2920) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 09:42:45 +02:00
Ettore Di Giacinto
1d605073a4
models(gallery): add big-tiger-gemma-27b-v1 (#2918) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 09:10:08 +02:00
Dave
fc29c04f82
groundwork: add pkg/concurrency and the associated test file (#2745) 
groundwork: add pkg/concurrency and the associated test case

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-07-18 23:29:21 +00:00
Ettore Di Giacinto
11cb7a0b13
Merge branch 'master' into default_miro 2024-07-18 23:25:13 +02:00
Ettore Di Giacinto
63fc22baab
Update comment-pr.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 23:25:03 +02:00
Ettore Di Giacinto
7c27c91b2d
Merge branch 'master' into default_miro 2024-07-18 23:21:35 +02:00
LocalAI [bot]
6a919b30ac
chore: ⬆️ Update ggerganov/llama.cpp (#2917) 
⬆️ Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-18 23:21:17 +02:00
LocalAI [bot]
3f7ec2e596
feat(swagger): update swagger (#2916) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-18 23:20:52 +02:00
Ettore Di Giacinto
82d5123c1e
Update comment-pr.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 23:20:37 +02:00
Ettore Di Giacinto
252961751c
feat(federation): add load balanced option (#2915) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 23:18:53 +02:00
Ettore Di Giacinto
031627584b
ci: try to fix commit-pr workflow 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 19:44:18 +02:00
Ettore Di Giacinto
24a8eebcef
refactor: move federated server logic to its own service (#2914) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 19:15:15 +02:00
Ettore Di Giacinto
c0d17c2ff6
Merge branch 'master' into default_miro 2024-07-18 17:52:32 +02:00
Ettore Di Giacinto
bf9dd1de7f
feat(functions): parse broken JSON when we parse the raw results, use dynamic rules for grammar keys (#2912) 
* feat(functions): enhance parsing with broken JSON when we parse the raw results

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* breaking: make function name by default

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(grammar): dynamically generate grammars with mutating keys

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactor: simplify condition

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update docs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 17:52:22 +02:00
Ettore Di Giacinto
35d55572ac
fix: do not list txt files as potential models (#2910) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 14:44:44 +02:00
Ettore Di Giacinto
c7357a9872
fix: short-circuit when nodes aren't detected (#2909) 
Fixes:

```
panic: invalid argument to IntN

goroutine 401 [running]:
math/rand/v2.(*Rand).IntN(...)
        /home/mudler/_git/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.4.linux-amd64/src/math/rand/v2/rand.go:190
math/rand/v2.IntN(...)
        /home/mudler/_git/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.4.linux-amd64/src/math/rand/v2/rand.go:307
github.com/mudler/LocalAI/core/cli.Proxy.func2()
        /home/mudler/_git/LocalAI/core/cli/federated.go:104 +0x76e
created by github.com/mudler/LocalAI/core/cli.Proxy in goroutine 1
        /home/mudler/_git/LocalAI/core/cli/federated.go:91 +0x3c5
```

When no nodes are found and something is trying to hit the federated
endpoint (and no tunnels are ready yet).

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 14:44:31 +02:00
Ettore Di Giacinto
27e16a00fa ci: correctly use the pinned nvidia version 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 14:36:26 +02:00
LocalAI [bot]
919e2e4369
feat(swagger): update swagger (#2908) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-18 11:42:45 +00:00
Ettore Di Giacinto
4e4078854b fix(llama.cpp): disable mirostat as default 
Even if increasing the quality of the output, it has shown to have
performance drawbacks to be so noticeable that the confuses users about
speed of LocalAI ( see also
https://github.com/mudler/LocalAI/issues/2780 ).

This changeset disables Mirostat by default (which can
be still enabled manually).

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 12:35:11 +02:00
Ettore Di Giacinto
96f67efe32 ci(swagger): run protogen-go before 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 11:28:44 +02:00
Ettore Di Giacinto
607900a4bb
docs: more swagger, update docs (#2907) 
* docs(swagger): finish convering gallery section

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs: add section to explain how to install models with local-ai run

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Minor docs adjustments

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 11:25:21 +02:00
Ettore Di Giacinto
53c8ab1020
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 10:01:08 +02:00
Ettore Di Giacinto
81d01e8a5f
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 10:00:05 +02:00
Ettore Di Giacinto
b8b0c7ad0b
docs(swagger): core more localai/openai endpoints (#2904) 
* docs(swagger): core more localai/openai endpoints

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix swagger descriptions for backend_monitor.go

Signed-off-by: Dave <dave@gray101.com>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Dave <dave@gray101.com>
Co-authored-by: Dave <dave@gray101.com>
 2024-07-18 00:38:41 -04:00
Ikko Eltociear Ashimine
6de12c694a
docs: update try-it-out.md (#2906) 2024-07-18 03:21:22 +00:00
LocalAI [bot]
25f97910cc
chore: ⬆️ Update ggerganov/llama.cpp (#2905) 
⬆️ Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-17 21:45:10 +00:00
Ettore Di Giacinto
89bd04c0ac
models(gallery): add flammenai/Mahou-1.3d-mistral-7B (#2903) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-17 20:13:24 +02:00
Ettore Di Giacinto
195d3b9f03
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-17 20:11:52 +02:00
Ettore Di Giacinto
865496f80b
models(gallery): add MythicalMaid/EtherealMaid 15b (#2902) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-17 19:29:43 +02:00
Ettore Di Giacinto
4a22e54cda
Update comment-pr.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-17 19:29:27 +02:00
Ettore Di Giacinto
bd8e2320c3
models(gallery): add mathstral-7b-v0.1-imat (#2901) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-17 18:19:54 +02:00
Ettore Di Giacinto
b5661d6302
Update comment-pr.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-17 18:19:41 +02:00
Ettore Di Giacinto
e7813d4ec4
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-17 15:14:22 +02:00
Ettore Di Giacinto
d384627fa9
ci: evaluate diff from base branch 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-17 08:45:11 +02:00
Ettore Di Giacinto
1ed6b96dd7
ci: use github action (#2899) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-16 23:57:01 -04:00
LocalAI [bot]
53f90218b0
chore: ⬆️ Update ggerganov/llama.cpp (#2897) 
⬆️ Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-16 23:13:02 +00:00
LocalAI [bot]
112d6a3083
chore: ⬆️ Update ggerganov/whisper.cpp (#2898) 
⬆️ Update ggerganov/whisper.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-16 22:42:43 +00:00
Dave
1f7cedf5ee
build: fix go.mod - don't import ourself (#2896) 
* minor cleanup to go.mod - importing ourself?

Signed-off-by: Dave Lee <dave@gray101.com>

* figured out why we were importing ourself and fixed it

Signed-off-by: Dave Lee <dave@gray101.com>

* set pull_request_target

Signed-off-by: Dave Lee <dave@gray101.com>

---------

Signed-off-by: Dave Lee <dave@gray101.com>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-16 22:49:43 +02:00