feat(gallery): add llama3, hermes, phi-3, and others (#2110)

Also adds embeddings and llava models

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2024-04-23 19:35:45 +02:00 committed by GitHub
parent d344daf129
commit 8b169f1dac
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
11 changed files with 804 additions and 229 deletions

21
gallery/codellama.yaml Normal file
View file

@ -0,0 +1,21 @@
name: "codellama"
license: llama2
description: |
Code Llama is a collection of pretrained and fine-tuned generative text models ranging in scale from 7 billion to 34 billion parameters. This model is designed for general code synthesis and understanding.
urls:
- https://huggingface.co/TheBloke/CodeLlama-7B-GGUF
- https://huggingface.co/meta-llama/CodeLlama-7b-hf
tags:
- llm
- gguf
- gpu
- cpu
config_file: |
backend: llama-cpp
context_size: 4096
f16: true
mmap: true