LocalAI/gallery/smolvlm.yaml
Ettore Di Giacinto ec21b58008
chore(model gallery): add smolvlm-256m-instruct (#5412)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2025-05-20 11:15:09 +02:00

19 lines
528 B
YAML

---
name: smolvlm
# yamllint disable-line rule:trailing-spaces
config_file: |
mmap: true
template:
chat_message: |
{{if eq .RoleName "assistant"}}Assistant{{else if eq .RoleName "system"}}System{{else if eq .RoleName "user"}}User{{end}}: {{.Content }}<end_of_utterance>
chat: "<|im_start|>\n{{.Input -}}\nAssistant: "
completion: |
{{-.Input}}
f16: true
stopwords:
- '<|im_end|>'
- '<dummy32000>'
- '</s>'
- '<|'
- '<end_of_utterance>'
- '<|endoftext|>'