dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-01 16:34:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 15

feat: add trimsuffix (#1528)

Browse source
This commit is contained in:
Ettore Di Giacinto 2024-01-01 08:39:42 -05:00 • committed by GitHub
parent fd48cb6506
commit 85e2767dca
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
3 changed files with 18 additions and 11 deletions
Download patch file Download diff file Expand all files Collapse all files

2
examples/configurations/phi-2.yaml
View file

@ -3,6 +3,8 @@ context_size: 2048
f16: true
gpu_layers: 90
mmap: true
trimsuffix:
- "\n"
parameters:
model: huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf
temperature: 0.2