chore(model gallery): add falcon3-1b-instruct (#4423)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2024-12-18 10:12:06 +01:00 committed by GitHub
parent 0b4bb7a562
commit f52c6e3a31
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 65 additions and 0 deletions

View file

@ -1,4 +1,29 @@
---
- &falcon3
name: "falcon3-1b-instruct"
url: "github:mudler/LocalAI/gallery/falcon3.yaml@master"
icon: https://huggingface.co/datasets/tiiuae/documentation-images/resolve/main/general/falco3-logo.png
urls:
- https://huggingface.co/tiiuae/Falcon3-1B-Instruct
- https://huggingface.co/bartowski/Falcon3-1B-Instruct-GGUF
description: |
Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters.
This repository contains the Falcon3-1B-Instruct. It achieves strong results on reasoning, language understanding, instruction following, code and mathematics tasks. Falcon3-1B-Instruct supports 4 languages (English, French, Spanish, Portuguese) and a context length of up to 8K.
overrides:
parameters:
model: Falcon3-1B-Instruct-Q4_K_M.gguf
files:
- filename: Falcon3-1B-Instruct-Q4_K_M.gguf
sha256: d351a6506b7d21221f3858b04d98c8b1b7b108b85acde2b13b69d9cb06e2a7e9
uri: huggingface://bartowski/Falcon3-1B-Instruct-GGUF/Falcon3-1B-Instruct-Q4_K_M.gguf
tags:
- llm
- gguf
- gpu
- cpu
- falcon
license: falcon-llm
- &intellect1
name: "intellect-1-instruct"
url: "github:mudler/LocalAI/gallery/llama3.1-instruct.yaml@master"