Add examples/config defaults

This commit is contained in:
Ettore Di Giacinto 2023-11-10 18:34:19 +01:00
parent 8254df3f4c
commit f995f23042
4 changed files with 58 additions and 1 deletions

5
.env
View file

@ -66,4 +66,7 @@ MODELS_PATH=/models
### Python backends GRPC max workers
### Default number of workers for GRPC Python backends.
### This actually controls wether a backend can process multiple requests or not.
# PYTHON_GRPC_MAX_WORKERS=1
# PYTHON_GRPC_MAX_WORKERS=1
### Define the number of parallel LLAMA.cpp workers (Defaults to 1)
# LLAMACPP_PARALLEL=1