A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 06:45 UTC
Fix typo in adding_model.rst (#1947)
adpated -> adapted
Peter Götz committed
Dec 6, 2023 at 19:04 UTC
d940ce497e96bf86908248ea4b21417d0cf1c261
1 file changed
+1
-1
docs/source/models/adding_model.rst
+1
-1
@@ -26,7 +26,7 @@ This gives you the ability to modify the codebase and test your model.
26
------------------------
27
28
Clone the PyTorch model code from the HuggingFace Transformers repository and put it into the `vllm/model_executor/models <https://github.com/vllm-project/vllm/tree/main/vllm/model_executor/models>`_ directory.
29
-For instance, vLLM's `OPT model <https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/opt.py>`_ was adpated from the HuggingFace's `modeling_opt.py <https://github.com/huggingface/transformers/blob/main/src/transformers/models/opt/modeling_opt.py>`_ file.
29
+For instance, vLLM's `OPT model <https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/opt.py>`_ was adapted from the HuggingFace's `modeling_opt.py <https://github.com/huggingface/transformers/blob/main/src/transformers/models/opt/modeling_opt.py>`_ file.
30
31
.. warning::
32
When copying the model code, make sure to review and adhere to the code's copyright and licensing terms.