dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-15 23:34:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 16

models(gallery): add phi-3 vision (#3890)

Browse source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2024-10-21 11:47:52 +02:00 • committed by GitHub
parent 313ea2c4d2
commit 015835dba2
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 36 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

23
gallery/phi-3-vision.yaml Normal file
View file

@ -0,0 +1,23 @@
---
name: "phi3-vision"
config_file: |
name: phi3-vision
backend: vllm
parameters:
model: microsoft/Phi-3-vision-128k-instruct
trust_remote_code: true
max_model_len: 32768
template:
chat_message: |-
<|{{ .RoleName }}|>
{{.Content}}<|end|>
chat: >-
{{.Input}}
<|assistant|>
completion: |
{{.Input}}
use_tokenizer_template: false
image: "<|image_{{ add1 .ID }}|>\n{{.Text}}"