LocalAI/core/cli/worker
Ettore Di Giacinto 36e185ba63
feat(p2p): allow to run multiple clusters in the same p2p network (#3128)
feat(p2p): allow to run multiple clusters in the same network

Allow to specify a network ID via CLI which allows to run multiple
clusters, logically separated within the same network (by using the same
shared token).

Note: This segregation is not "secure" by any means, anyone having the
network token can see the services available in all the network,
however, this provides a way to separate the inference endpoints.

This allows for instance to have a node which is both federated and
having attached a set of llama.cpp workers.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
2024-08-07 23:35:44 +02:00
..
worker.go feat(llama.cpp): Totally decentralized, private, distributed, p2p inference (#2343) 2024-05-20 19:17:59 +02:00
worker_llamacpp.go chore: fix go.mod module (#2635) 2024-06-23 08:24:36 +00:00
worker_nop2p.go chore: fix go.mod module (#2635) 2024-06-23 08:24:36 +00:00
worker_p2p.go feat(p2p): allow to run multiple clusters in the same p2p network (#3128) 2024-08-07 23:35:44 +02:00