fix: add rope settings during model load, fix CUDA (#821)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto 2023-07-27 21:56:05 +02:00 committed by GitHub
parent 147cae9ed8
commit 096d98c3d9
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
7 changed files with 176 additions and 148 deletions

View file

@ -4,8 +4,7 @@ GOVET=$(GOCMD) vet
BINARY_NAME=local-ai
# llama.cpp versions
# Temporarly pinned to https://github.com/go-skynet/go-llama.cpp/pull/124
GOLLAMA_VERSION?=562d2b5a71195627a63bb34f639e0fb0e2b2df3f
GOLLAMA_VERSION?=6ba16de8e965e5aa0f32d25ef9d6149bb6586565
# gpt4all version
GPT4ALL_REPO?=https://github.com/nomic-ai/gpt4all