@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 00afc78590
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 19:30 UTC

[Bugfix] add gguf dependency (#7198)

Co-authored-by: katarzyna.papis <kpapis@kpapis-u20.sclab.intel.com>

Katarzyna Papis committed Aug 6, 2024 at 19:08 UTC 00afc7859072bdcaba30611c6563f2f7ac7104a3
1 file changed +1
requirements-openvino.txt
+1
@@ -25,6 +25,7 @@ outlines >= 0.0.43, < 0.1 # Requires torch >= 2.1.0
25 typing_extensions
26 filelock >= 3.10.4 # filelock starts to support `mode` argument from 3.10.4
27 pyzmq
28 +gguf == 0.9.1
29
30 # OpenVINO dependencies
31 torch >= 2.1.2