mirror of
https://github.com/mudler/LocalAI.git
synced 2025-05-20 18:45:00 +00:00
![]() * Bump oneapi-basekit, optimum and openvino * Changed PERFORMANCE HINT to CUMULATIVE_THROUGHPUT Minor latency change for first token but about 10-15% speedup on token generation. |
||
---|---|---|
.. | ||
Makefile | ||
README.md | ||
run.sh | ||
test.sh | ||
test_transformers_server.py | ||
transformers_server.py |
Creating a separate environment for the transformers project
make transformers