A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 11:00 UTC
[doc] update the issue link (#17782)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
Reid committed
May 7, 2025 at 20:29 UTC
7377dd0307a56a3a5cd0214a8b7226e9ebdc5ad6
3 files changed
+3
-3
docs/source/features/quantization/fp8.md
+1
-1
@@ -117,7 +117,7 @@ Here's an example of the resulting scores:
117
118
## Troubleshooting and Support
119
120
-If you encounter any issues or have feature requests, please open an issue on the `vllm-project/llm-compressor` GitHub repository.
120
+If you encounter any issues or have feature requests, please open an issue on the [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor/issues) GitHub repository.
121
122
## Online Dynamic Quantization
123
docs/source/features/quantization/int4.md
+1
-1
@@ -169,4 +169,4 @@ recipe = GPTQModifier(
169
170
## Troubleshooting and Support
171
172
-If you encounter any issues or have feature requests, please open an issue on the [`vllm-project/llm-compressor`](https://github.com/vllm-project/llm-compressor) GitHub repository. The full INT4 quantization example in `llm-compressor` is available [here](https://github.com/vllm-project/llm-compressor/blob/main/examples/quantization_w4a16/llama3_example.py).
172
+If you encounter any issues or have feature requests, please open an issue on the [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor/issues) GitHub repository. The full INT4 quantization example in `llm-compressor` is available [here](https://github.com/vllm-project/llm-compressor/blob/main/examples/quantization_w4a16/llama3_example.py).
docs/source/features/quantization/int8.md
+1
-1
@@ -138,4 +138,4 @@ Quantized models can be sensitive to the presence of the `bos` token. Make sure
138
139
## Troubleshooting and Support
140
141
-If you encounter any issues or have feature requests, please open an issue on the [`vllm-project/llm-compressor`](https://github.com/vllm-project/llm-compressor) GitHub repository.
141
+If you encounter any issues or have feature requests, please open an issue on the [vllm-project/llm-compressor](https://github.com/vllm-project/llm-compressor/issues) GitHub repository.