@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 5ce4627a7e
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 03:15 UTC

[Doc] Add xgrammar in doc (#11549)

Signed-off-by: ccjincong <chenjincong11@gmail.com>

Chen1022 committed Dec 27, 2024 at 21:05 UTC 5ce4627a7ec4cf4e19ff4be7f030883ef486393f
1 file changed +1 -1
docs/source/usage/structured_outputs.md
+1 -1
@@ -2,7 +2,7 @@
2
3 # Structured Outputs
4
5 -vLLM supports the generation of structured outputs using [outlines](https://github.com/dottxt-ai/outlines) or [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer) as backends for the guided decoding.
5 +vLLM supports the generation of structured outputs using [outlines](https://github.com/dottxt-ai/outlines), [lm-format-enforcer](https://github.com/noamgat/lm-format-enforcer), or [xgrammar](https://github.com/mlc-ai/xgrammar) as backends for the guided decoding.
6 This document shows you some examples of the different options that are available to generate structured outputs.
7
8 ## Online Inference (OpenAI API)