dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-30 06:30:43 +00:00
Code Issues Projects Releases Packages Wiki Activity

stash progress for the night. loading GPTJ fails, hacked in PredictTEMP as kludge

Browse source
This commit is contained in:
Dave Lee 2023-06-08 03:11:52 -04:00
parent 8fc4b6cded
commit 0b910e0595
14 changed files with 518 additions and 193 deletions
Download patch file Download diff file Expand all files Collapse all files

2
config/gpt-3.5-turbo-chat.yaml
View file

@ -4,6 +4,8 @@ registration:
local_paths:
model: ggml-gpt4all-j
template: chat-gpt4all
backend: gptj
threads: 4
request_defaults:
top_p: 0.7
temperature: 0.2

2
config/gpt-3.5-turbo-completion.yaml
View file

@ -4,6 +4,8 @@ registration:
local_paths:
model: ggml-gpt4all-j
template: chat-gpt4all
backend: gptj
threads: 4
request_defaults:
top_p: 0.7
temperature: 0.2