From dda5b9f2609182192291d81be729a019365275b5 Mon Sep 17 00:00:00 2001 From: Ettore Di Giacinto Date: Sat, 22 Jun 2024 10:05:48 +0200 Subject: [PATCH] Update distributed_inferencing.md Signed-off-by: Ettore Di Giacinto --- docs/content/docs/features/distributed_inferencing.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/docs/content/docs/features/distributed_inferencing.md b/docs/content/docs/features/distributed_inferencing.md index e7220a81..c76b9f29 100644 --- a/docs/content/docs/features/distributed_inferencing.md +++ b/docs/content/docs/features/distributed_inferencing.md @@ -95,5 +95,6 @@ The server logs should indicate that new workers are being discovered. ## Notes +- If running in p2p mode, make sure you start the container with `--net host` or `network_mode: host` in the docker-compose file. - Only a single model is supported currently. -- Ensure the server detects new workers before starting inference. Currently, additional workers cannot be added once inference has begun. \ No newline at end of file +- Ensure the server detects new workers before starting inference. Currently, additional workers cannot be added once inference has begun.