A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 13:30 UTC
[doc] add download path tips (#17013)
Signed-off-by: reidliu41 <reid201711@gmail.com> Co-authored-by: reidliu41 <reid201711@gmail.com>
Reid committed
Apr 23, 2025 at 12:06 UTC
eb8ef4224da757bf8ea1c738f9514601835f8bbb
1 file changed
+1
-1
docs/source/models/supported_models.md
+1
-1
@@ -133,7 +133,7 @@ class MyConfig(PretrainedConfig):
133
134
### Hugging Face Hub
135
136
-By default, vLLM loads models from [Hugging Face (HF) Hub](https://huggingface.co/models).
136
+By default, vLLM loads models from [Hugging Face (HF) Hub](https://huggingface.co/models). To change the download path for models, you can set the `HF_HOME` environment variable; for more details, refer to [their official documentation](https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables#hfhome).
137
138
To determine whether a given model is natively supported, you can check the `config.json` file inside the HF repository.
139
If the `"architectures"` field contains a model architecture listed below, then it should be natively supported.