A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 9, 05:00 UTC
pin LMCache to v0.3.9 or greater with vLLM v0.15.0 (#33440)
Signed-off-by: greg pereira <grpereir@redhat.com> Co-authored-by: Michael Goin <mgoin64@gmail.com>
Greg Pereira committed
Jan 31, 2026 at 19:50 UTC
d6416fdde93476afc51a51e391a9b44d2c25df2f
1 file changed
+1
-1
requirements/kv_connectors.txt
+1
-1
@@ -1,2 +1,2 @@
1
-lmcache
1
+lmcache >= 0.3.9
2
nixl >= 0.7.1 # Required for disaggregated prefill