@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 57792ed469
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 18:15 UTC

[Doc] Fix incorrect docs from #7615 (#7788)

Peter Salas committed Aug 22, 2024 at 10:02 UTC 57792ed469956c7e580f982d590fcacea882570b
2 files changed +3 -3
docs/source/models/supported_models.rst
+2 -2
@@ -234,10 +234,10 @@ Multimodal Language Models
234 - Image
235 - :code:`openbmb/MiniCPM-V-2` (see note), :code:`openbmb/MiniCPM-Llama3-V-2_5`, :code:`openbmb/MiniCPM-V-2_6`, etc.
236 -
237 - * - :code: `UltravoxModel`
237 + * - :code:`UltravoxModel`
238 - Ultravox
239 - Audio
240 - - :code: `fixie-ai/ultravox-v0_3`
240 + - :code:`fixie-ai/ultravox-v0_3`
241 -
242
243 .. note::
examples/offline_inference_audio_language.py
+1 -1
@@ -1,6 +1,6 @@
1 """
2 This example shows how to use vLLM for running offline inference
3 -with the correct prompt format on vision language models.
3 +with the correct prompt format on audio language models.
4
5 For most models, the prompt format should follow corresponding examples
6 on HuggingFace model repository.