A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 02:00 UTC
[Doc] Update Quantization Hardware Support Documentation (#12025)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com> Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
TJian committed
Jan 14, 2025 at 12:37 UTC
8a1f938e6f02052df0f4953c149410605a2d56d8
1 file changed
+1
-1
docs/source/features/quantization/supported_hardware.md
+1
-1
@@ -113,7 +113,7 @@ The table below shows the compatibility of various quantization implementations
113
- ✅︎
114
- ✅︎
115
- ✅︎
116
- - ✗
116
+ - ✅︎
117
- ✗
118
- ✗
119
- ✗