dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-02 17:04:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 13

docs(phi-2): add example (#1525)

Browse source
This commit is contained in:
Ettore Di Giacinto 2024-01-01 04:51:47 -05:00 • committed by GitHub
parent 726fe416bb
commit f068efe509
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 26 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

15
examples/configurations/phi-2.yaml Normal file
View file

@ -0,0 +1,15 @@
name: phi-2
context_size: 2048
f16: true
gpu_layers: 90
mmap: true
parameters:
model: huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf
temperature: 0.2
top_k: 40
top_p: 0.95
template:
chat: &template |
Instruct: {{.Input}}
Output:
completion: *template