A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 06:00 UTC
[Doc] Fix quantization link titles (#19478)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Cyrus Leung committed
Jun 11, 2025 at 16:27 UTC
a5115f4ff567e1311e0a5016519e8aa4ba6e0c98
2 files changed
+14
-14
docs/features/quantization/README.md
+13
-13
@@ -7,16 +7,16 @@ Quantization trades off model precision for smaller memory footprint, allowing l
7
8
Contents:
9
10
-- [Supported_Hardware](supported_hardware.md)
11
-- [Auto_Awq](auto_awq.md)
12
-- [Bnb](bnb.md)
13
-- [Bitblas](bitblas.md)
14
-- [Gguf](gguf.md)
15
-- [Gptqmodel](gptqmodel.md)
16
-- [Int4](int4.md)
17
-- [Int8](int8.md)
18
-- [Fp8](fp8.md)
19
-- [Modelopt](modelopt.md)
20
-- [Quark](quark.md)
21
-- [Quantized_Kvcache](quantized_kvcache.md)
22
-- [Torchao](torchao.md)
10
+- [Supported Hardware](supported_hardware.md)
11
+- [AutoAWQ](auto_awq.md)
12
+- [BitsAndBytes](bnb.md)
13
+- [BitBLAS](bitblas.md)
14
+- [GGUF](gguf.md)
15
+- [GPTQModel](gptqmodel.md)
16
+- [INT4 W4A16](int4.md)
17
+- [INT8 W8A8](int8.md)
18
+- [FP8 W8A8](fp8.md)
19
+- [NVIDIA TensorRT Model Optimizer](modelopt.md)
20
+- [AMD Quark](quark.md)
21
+- [Quantized KV Cache](quantized_kvcache.md)
22
+- [TorchAO](torchao.md)
docs/features/quantization/quark.md
+1
-1
@@ -1,5 +1,5 @@
1
---
2
-title: AMD QUARK
2
+title: AMD Quark
3
---
4
[](){ #quark }
5