A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 14:45 UTC
[doc] update the wrong link (#16401)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
Reid committed
Apr 10, 2025 at 21:02 UTC
ce8d6b75fc0586045df75ee1568a5b5f9957251b
2 files changed
+2
-2
.github/ISSUE_TEMPLATE/600-new-model.yml
+1
-1
@@ -9,7 +9,7 @@ body:
9
value: >
10
#### Before submitting an issue, please make sure the issue hasn't been already addressed by searching through [the existing and past issues](https://github.com/vllm-project/vllm/issues?q=is%3Aissue+sort%3Acreated-desc+).
11
12
- #### We also highly recommend you read https://docs.vllm.ai/en/latest/contributing/model/adding_model.html first to understand how to add a new model.
12
+ #### We also highly recommend you read https://docs.vllm.ai/en/latest/contributing/model/index.html first to understand how to add a new model.
13
- type: textarea
14
attributes:
15
label: The model to consider.
docs/source/models/extensions/tensorizer.md
+1
-1
@@ -9,7 +9,7 @@ shorter Pod startup times and CPU memory usage. Tensor encryption is also suppor
9
10
For more information on CoreWeave's Tensorizer, please refer to
11
[CoreWeave's Tensorizer documentation](https://github.com/coreweave/tensorizer). For more information on serializing a vLLM model, as well a general usage guide to using Tensorizer with vLLM, see
12
-the [vLLM example script](https://docs.vllm.ai/en/stable/getting_started/examples/offline_inference/tensorize_vllm_model.html).
12
+the [vLLM example script](https://docs.vllm.ai/en/latest/getting_started/examples/tensorize_vllm_model.html).
13
14
:::{note}
15
Note that to use this feature you will need to install `tensorizer` by running `pip install vllm[tensorizer]`.