LocalAI/core
Ettore Di Giacinto f895d06605
fix(config): set better defaults for inferencing (#1822)
* fix(defaults): set better defaults for inferencing

This changeset aim to have better defaults and to properly detect when
no inference settings are provided with the model.

If not specified, we defaults to mirostat sampling, and offload all the
GPU layers (if a GPU is detected).

Related to https://github.com/mudler/LocalAI/issues/1373 and https://github.com/mudler/LocalAI/issues/1723

* Adapt tests

* Also pre-initialize default seed
2024-03-13 10:05:30 +01:00
..
backend fix(config): set better defaults for inferencing (#1822) 2024-03-13 10:05:30 +01:00
config fix(config): set better defaults for inferencing (#1822) 2024-03-13 10:05:30 +01:00
http fix(config): set better defaults for inferencing (#1822) 2024-03-13 10:05:30 +01:00
schema fix(config): set better defaults for inferencing (#1822) 2024-03-13 10:05:30 +01:00
services refactor: move remaining api packages to core (#1731) 2024-03-01 16:19:53 +01:00
startup refactor: move remaining api packages to core (#1731) 2024-03-01 16:19:53 +01:00