dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-06-30 06:30:43 +00:00
Code Issues Projects Releases Packages Wiki Activity

Not anywhere close to done, but getting back to this and staging some progress. Preliminary pass on loading a config and overriding params with request json.

Browse source
This commit is contained in:
Dave Lee 2023-06-01 03:31:55 -04:00
parent fc3c105d42
commit 20a0cd2f66
No known key found for this signature in database
13 changed files with 812 additions and 388 deletions
Download patch file Download diff file Expand all files Collapse all files

11
config/gpt-3.5-turbo-chat.yaml Normal file
View file

@ -0,0 +1,11 @@
registration:
model: gpt-3.5-turbo
endpoint: CreateChatCompletion
local_paths:
model: ggml-gpt4all-j
template: chat-gpt4all
request_defaults:
top_p: 0.7
temperature: 0.2
x-localai-extensions:
top_k: 80