A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 13:30 UTC
[doc] update hyperlink (#16877)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
Reid committed
Apr 20, 2025 at 00:40 UTC
d6195a748b3d68d3e81a4f09513ece4e04f5c571
1 file changed
+1
-1
docs/source/models/extensions/fastsafetensor.md
+1
-1
@@ -1,5 +1,5 @@
1
Loading Model weights with fastsafetensors
2
===================================================================
3
4
-Using fastsafetensor library enables loading model weights to GPU memory by leveraging GPU direct storage. See https://github.com/foundation-model-stack/fastsafetensors for more details.
4
+Using fastsafetensors library enables loading model weights to GPU memory by leveraging GPU direct storage. See [their GitHub repository](https://github.com/foundation-model-stack/fastsafetensors) for more details.
5
For enabling this feature, set the environment variable ``USE_FASTSAFETENSOR`` to ``true``