@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 8a1f938e6f
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 02:00 UTC

[Doc] Update Quantization Hardware Support Documentation (#12025)

Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com> Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

TJian committed Jan 14, 2025 at 12:37 UTC 8a1f938e6f02052df0f4953c149410605a2d56d8
1 file changed +1 -1
docs/source/features/quantization/supported_hardware.md
+1 -1
@@ -113,7 +113,7 @@ The table below shows the compatibility of various quantization implementations
113 - ✅︎
114 - ✅︎
115 - ✅︎
116 - - ✗
116 + - ✅︎
117 - ✗
118 - ✗
119 - ✗