A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 7, 14:00 UTC
[Doc] Fix link to Llama chat template for usability (#35525)
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Martin Hickey committed
Feb 27, 2026 at 17:51 UTC
b602e4f299a596a14402e6a4ead5e51abb180c49
1 file changed
+1
-1
docs/serving/openai_compatible_server.md
+1
-1
@@ -84,7 +84,7 @@ In order for the language model to support chat protocol, vLLM requires the mode
84
a chat template in its tokenizer configuration. The chat template is a Jinja2 template that
85
specifies how roles, messages, and other chat-specific tokens are encoded in the input.
86
87
-An example chat template for `NousResearch/Meta-Llama-3-8B-Instruct` can be found [here](https://github.com/meta-llama/llama3?tab=readme-ov-file#instruction-tuned-models)
87
+An example chat template for `NousResearch/Meta-Llama-3-8B-Instruct` can be found [here](https://llama.com/docs/model-cards-and-prompt-formats/meta-llama-3/#prompt-template-for-meta-llama-3)
88
89
Some models do not provide a chat template even though they are instruction/chat fine-tuned. For those models,
90
you can manually specify their chat template in the `--chat-template` parameter with the file path to the chat