dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-20 02:24:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 21

chore(model gallery): add smoothie-qwen3-8b (#5306)

Browse source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2025-05-03 10:35:20 +02:00 • committed by GitHub
parent 1da0644aa3
commit 05848b2027
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 15 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

15
gallery/index.yaml
View file

@ -427,6 +427,21 @@
- filename: Qwen-3-32B-Medical-Reasoning.i1-Q4_K_M.gguf
sha256: 3d5ca0c8dfde8f9466e4d89839f08cd2f45ef97d6c28fa61f9428645877497b0
uri: huggingface://mradermacher/Qwen-3-32B-Medical-Reasoning-i1-GGUF/Qwen-3-32B-Medical-Reasoning.i1-Q4_K_M.gguf
- !!merge <<: *qwen3
name: "smoothie-qwen3-8b"
icon: https://github.com/dnotitia/smoothie-qwen/raw/main/asset/smoothie-qwen-logo.png
urls:
- https://huggingface.co/dnotitia/Smoothie-Qwen3-8B
- https://huggingface.co/mradermacher/Smoothie-Qwen3-8B-GGUF
description: |
Smoothie Qwen is a lightweight adjustment tool that smooths token probabilities in Qwen and similar models, enhancing balanced multilingual generation capabilities. For more details, please refer to https://github.com/dnotitia/smoothie-qwen.
overrides:
parameters:
model: Smoothie-Qwen3-8B.Q4_K_M.gguf
files:
- filename: Smoothie-Qwen3-8B.Q4_K_M.gguf
sha256: 36fc6df285c35beb8f1fdb46b3854bc4f420d3600afa397bf6a89e2ce5480112
uri: huggingface://mradermacher/Smoothie-Qwen3-8B-GGUF/Smoothie-Qwen3-8B.Q4_K_M.gguf
- &gemma3
url: "github:mudler/LocalAI/gallery/gemma.yaml@master"
name: "gemma-3-27b-it"