A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 06:00 UTC
[Docs] Note that alternative structured output backends are supported (#19426)
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Russell Bryant committed
Jun 10, 2025 at 12:20 UTC
da9b523ce1fd5c27bfd18921ba0388bf2e8e4618
1 file changed
+1
-8
docs/usage/v1_guide.md
+1
-8
@@ -54,7 +54,7 @@ This living user guide outlines a few known **important changes and limitations*
54
| **FP8 KV Cache** | <nobr>🟢 Functional on Hopper devices ([PR #15191](https://github.com/vllm-project/vllm/pull/15191))</nobr>|
55
| **Spec Decode** | <nobr>🚧 WIP ([PR #13933](https://github.com/vllm-project/vllm/pull/13933))</nobr>|
56
| **Prompt Logprobs with Prefix Caching** | <nobr>🟡 Planned ([RFC #13414](https://github.com/vllm-project/vllm/issues/13414))</nobr>|
57
-| **Structured Output Alternative Backends** | <nobr>🟡 Planned</nobr> |
57
+| **Structured Output Alternative Backends** | <nobr>🟢 Functional</nobr> |
58
| **Embedding Models** | <nobr>🚧 WIP ([PR #16188](https://github.com/vllm-project/vllm/pull/16188))</nobr> |
59
| **Mamba Models** | <nobr>🟡 Planned</nobr> |
60
| **Encoder-Decoder Models** | <nobr>🟠 Delayed</nobr> |
@@ -132,13 +132,6 @@ in progress.
132
- **Multimodal Models**: V1 is almost fully compatible with V0 except that interleaved modality input is not supported yet.
133
See [here](https://github.com/orgs/vllm-project/projects/8) for the status of upcoming features and optimizations.
134
135
-#### Features to Be Supported
136
-
137
-- **Structured Output Alternative Backends**: Structured output alternative backends (outlines, guidance) support is planned. V1 currently
138
- supports only the `xgrammar:no_fallback` mode, meaning that it will error out if the output schema is unsupported by xgrammar.
139
- Details about the structured outputs can be found
140
- [here](https://docs.vllm.ai/en/latest/features/structured_outputs.html).
141
-
135
#### Models to Be Supported
136
137
vLLM V1 currently excludes model architectures with the `SupportsV0Only` protocol,