Bump vLLM version + more options when loading models in vLLM (#1782)

Browse source

* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama

...

This commit is contained in:

Ludovic Leroux 2024-03-01 16:48:53 -05:00 • committed by GitHub

parent 1c312685aa

commit 939411300a

No known key found for this signature in database

GPG key ID: B5690EEEBB952194

28 changed files with 736 additions and 641 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

66

backend/python/exllama2/backend_pb2.py

View file

File diff suppressed because one or more lines are too long