dearwolf/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2025-05-27 22:15:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 12

feat: add ngqa and RMSNormEps parameters (#860)

Browse source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2023-08-03 00:51:08 +02:00 • committed by GitHub
parent 953e30814a
commit 5ca21ee398
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
7 changed files with 138 additions and 104 deletions
Download patch file Download diff file Expand all files Collapse all files

2
pkg/grpc/proto/backend.proto
View file

@ -87,6 +87,8 @@ message ModelOptions {
string LibrarySearchPath = 16;
float RopeFreqBase = 17;
float RopeFreqScale = 18;
float RMSNormEps = 19;
int32 NGQA = 20;
}
message Result {