accelerate
auto-gptq==0.7.1
grpcio==1.66.0
protobuf
certifi
transformers