feat(vllm): Initial vllm backend implementation

Browse source

Related to: https://github.com/go-skynet/LocalAI/issues/1015

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

...

This commit is contained in:

Ettore Di Giacinto 2023-09-09 16:46:13 +02:00

parent cc74fc93b4

commit c0bb5c4bf6

5 changed files with 527 additions and 2 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

61

extra/grpc/vllm/backend_pb2.py Normal file

View file

File diff suppressed because one or more lines are too long