@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 56a955e774
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 07:00 UTC

Bump to compressed-tensors v0.8.0 (#10279)

Signed-off-by: Dipika <dipikasikka1@gmail.com>

Dipika Sikka committed Nov 13, 2024 at 00:54 UTC 56a955e7748e497d8c24c79a76c75f3f982fab4a
1 file changed +1 -1
requirements-common.txt
+1 -1
@@ -31,4 +31,4 @@ pyyaml
31 six>=1.16.0; python_version > '3.11' # transitive dependency of pandas that needs to be the latest version for python 3.12
32 setuptools>=74.1.1; python_version > '3.11' # Setuptools is used by triton, we need to ensure a modern version is installed for 3.12+ so that it does not try to import distutils, which was removed in 3.12
33 einops # Required for Qwen2-VL.
34 -compressed-tensors == 0.7.1 # required for compressed-tensors
34 +compressed-tensors == 0.8.0 # required for compressed-tensors
\ No newline at end of file