dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-27 21:24:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 15
2241 commits 61 branches 115 tags 60 MiB
Commit graph

2241 commits

This branch
This branch
All branches
Author SHA1 Message Date
dependabot[bot]
a6b92af875
chore(deps): Bump grpcio from 1.64.1 to 1.65.1 in /backend/python/openvoice (#2956) 
chore(deps): Bump grpcio in /backend/python/openvoice

Bumps [grpcio](https://github.com/grpc/grpc) from 1.64.1 to 1.65.1.
- [Release notes](https://github.com/grpc/grpc/releases)
- [Changelog](https://github.com/grpc/grpc/blob/master/doc/grpc_release_schedule.md)
- [Commits](https://github.com/grpc/grpc/compare/v1.64.1...v1.65.1)

---
updated-dependencies:
- dependency-name: grpcio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-07-22 21:34:12 +00:00
LocalAI [bot]
3dc601c470
chore: ⬆️ Update ggerganov/llama.cpp (#2943) 
⬆️ Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-22 16:04:41 +00:00
Ettore Di Giacinto
153e977155
Update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-22 17:35:10 +02:00
fakezeta
7d61de63ae
fix: pin setuptools 69.5.1 (#2949) 
pin setuptools 69.5.1
 2024-07-22 15:40:34 +02:00
Ettore Di Giacinto
bcd9e153ba
ci(Makefile): reduce binary size by compressing (#2947) 
Makefile: try to reduce binary size

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-22 15:39:57 +02:00
Ettore Di Giacinto
19282af059
models(gallery): add calme-2.4-llama3-70b (#2942) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-21 22:01:15 +02:00
Ettore Di Giacinto
9c0c11e8a0
models(gallery): add StellarDong-72b (#2941) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-21 21:57:30 +02:00
Ettore Di Giacinto
3f7eddb039
models(gallery): add calme-2.8-qwen2-7b (#2940) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-21 21:51:52 +02:00
Ettore Di Giacinto
77ad49333a
models(gallery): add calme-2.3-phi3-4b (#2939) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-21 21:45:04 +02:00
Ettore Di Giacinto
ef5e8326c8
models(gallery): add celestev1.2 (#2937) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-21 10:31:44 +02:00
LocalAI [bot]
86509e6002
chore: ⬆️ Update ggerganov/llama.cpp (#2936) 
⬆️ Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-20 21:35:21 +00:00
LocalAI [bot]
8667a67695
docs: ⬆️ update docs version mudler/LocalAI (#2935) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-20 21:33:54 +00:00
Ettore Di Giacinto
f505d7ab3f
models(gallery): add archangel_sft_pythia2-8b (#2933) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-20 16:17:34 +02:00
Ettore Di Giacinto
450dbed820
models(gallery): add suzume-orpo (#2932) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-20 16:16:29 +02:00
Ettore Di Giacinto
46b86f7e6e
models(gallery): add tulu 8b and 70b (#2931) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-20 16:03:44 +02:00
Ettore Di Giacinto
0ee1f8c1cf
ci(Makefile): enable p2p on cross-arm64 builds (#2928) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-20 10:43:34 +02:00
Ettore Di Giacinto
87bd831aba
docs: add federation (#2929) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-20 10:43:18 +02:00
Ettore Di Giacinto
f9f83791d1
ci(release): run also on tags 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-20 09:15:48 +02:00
LocalAI [bot]
e75f73bf73
chore: ⬆️ Update ggerganov/llama.cpp (#2927) 
⬆️ Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-19 22:10:26 +00:00
LocalAI [bot]
bd277162c7
docs: ⬆️ update docs version mudler/LocalAI (#2926) 
⬆️ Update docs version mudler/LocalAI

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-19 21:56:58 +00:00
Dave
3ac4fe181a
Merge branch 'master' into default_miro 2024-07-19 14:41:39 -04:00
Ettore Di Giacinto
f19ee465d2
ci: disable comment-pr until it's fixed 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-19 19:00:36 +02:00
Ettore Di Giacinto
7b85ff7280
models(gallery): add celestev1 (#2925) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 18:43:30 +02:00
Ettore Di Giacinto
134cb993c2
models(gallery): add emo-2b (#2924) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 18:36:11 +02:00
Ettore Di Giacinto
2cf28f3c01
models(gallery): add gemma-2b-translation-v0.150 (#2923) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 18:31:27 +02:00
Ettore Di Giacinto
18c0f4718d
models(gallery): add einstein-v4-7b (#2922) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 15:20:15 +02:00
Ettore Di Giacinto
f878b63ee4
models(gallery): add qwen2-wukong-7b (#2921) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 09:48:05 +02:00
Ettore Di Giacinto
6eaa01db15
models(gallery): add phillama-3.8b-v0.1 (#2920) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 09:42:45 +02:00
Ettore Di Giacinto
1d605073a4
models(gallery): add big-tiger-gemma-27b-v1 (#2918) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-19 09:10:08 +02:00
Dave
fc29c04f82
groundwork: add pkg/concurrency and the associated test file (#2745) 
groundwork: add pkg/concurrency and the associated test case

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-07-18 23:29:21 +00:00
Ettore Di Giacinto
11cb7a0b13
Merge branch 'master' into default_miro 2024-07-18 23:25:13 +02:00
Ettore Di Giacinto
63fc22baab
Update comment-pr.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 23:25:03 +02:00
Ettore Di Giacinto
7c27c91b2d
Merge branch 'master' into default_miro 2024-07-18 23:21:35 +02:00
LocalAI [bot]
6a919b30ac
chore: ⬆️ Update ggerganov/llama.cpp (#2917) 
⬆️ Update ggerganov/llama.cpp

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-18 23:21:17 +02:00
LocalAI [bot]
3f7ec2e596
feat(swagger): update swagger (#2916) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-18 23:20:52 +02:00
Ettore Di Giacinto
82d5123c1e
Update comment-pr.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 23:20:37 +02:00
Ettore Di Giacinto
252961751c
feat(federation): add load balanced option (#2915) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 23:18:53 +02:00
Ettore Di Giacinto
031627584b
ci: try to fix commit-pr workflow 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 19:44:18 +02:00
Ettore Di Giacinto
24a8eebcef
refactor: move federated server logic to its own service (#2914) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 19:15:15 +02:00
Ettore Di Giacinto
c0d17c2ff6
Merge branch 'master' into default_miro 2024-07-18 17:52:32 +02:00
Ettore Di Giacinto
bf9dd1de7f
feat(functions): parse broken JSON when we parse the raw results, use dynamic rules for grammar keys (#2912) 
* feat(functions): enhance parsing with broken JSON when we parse the raw results

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* breaking: make function name by default

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(grammar): dynamically generate grammars with mutating keys

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* refactor: simplify condition

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update docs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 17:52:22 +02:00
Ettore Di Giacinto
35d55572ac
fix: do not list txt files as potential models (#2910) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 14:44:44 +02:00
Ettore Di Giacinto
c7357a9872
fix: short-circuit when nodes aren't detected (#2909) 
Fixes:

```
panic: invalid argument to IntN

goroutine 401 [running]:
math/rand/v2.(*Rand).IntN(...)
        /home/mudler/_git/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.4.linux-amd64/src/math/rand/v2/rand.go:190
math/rand/v2.IntN(...)
        /home/mudler/_git/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.22.4.linux-amd64/src/math/rand/v2/rand.go:307
github.com/mudler/LocalAI/core/cli.Proxy.func2()
        /home/mudler/_git/LocalAI/core/cli/federated.go:104 +0x76e
created by github.com/mudler/LocalAI/core/cli.Proxy in goroutine 1
        /home/mudler/_git/LocalAI/core/cli/federated.go:91 +0x3c5
```

When no nodes are found and something is trying to hit the federated
endpoint (and no tunnels are ready yet).

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 14:44:31 +02:00
Ettore Di Giacinto
27e16a00fa ci: correctly use the pinned nvidia version 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 14:36:26 +02:00
LocalAI [bot]
919e2e4369
feat(swagger): update swagger (#2908) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-07-18 11:42:45 +00:00
Ettore Di Giacinto
4e4078854b fix(llama.cpp): disable mirostat as default 
Even if increasing the quality of the output, it has shown to have
performance drawbacks to be so noticeable that the confuses users about
speed of LocalAI ( see also
https://github.com/mudler/LocalAI/issues/2780 ).

This changeset disables Mirostat by default (which can
be still enabled manually).

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 12:35:11 +02:00
Ettore Di Giacinto
96f67efe32 ci(swagger): run protogen-go before 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 11:28:44 +02:00
Ettore Di Giacinto
607900a4bb
docs: more swagger, update docs (#2907) 
* docs(swagger): finish convering gallery section

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs: add section to explain how to install models with local-ai run

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Minor docs adjustments

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-18 11:25:21 +02:00
Ettore Di Giacinto
53c8ab1020
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 10:01:08 +02:00
Ettore Di Giacinto
81d01e8a5f
Update README.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-18 10:00:05 +02:00