A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 18:15 UTC
[Doc] Fix incorrect docs from #7615 (#7788)
Peter Salas committed
Aug 22, 2024 at 10:02 UTC
57792ed469956c7e580f982d590fcacea882570b
2 files changed
+3
-3
docs/source/models/supported_models.rst
+2
-2
@@ -234,10 +234,10 @@ Multimodal Language Models
234
- Image
235
- :code:`openbmb/MiniCPM-V-2` (see note), :code:`openbmb/MiniCPM-Llama3-V-2_5`, :code:`openbmb/MiniCPM-V-2_6`, etc.
236
-
237
- * - :code: `UltravoxModel`
237
+ * - :code:`UltravoxModel`
238
- Ultravox
239
- Audio
240
- - :code: `fixie-ai/ultravox-v0_3`
240
+ - :code:`fixie-ai/ultravox-v0_3`
241
-
242
243
.. note::
examples/offline_inference_audio_language.py
+1
-1
@@ -1,6 +1,6 @@
1
"""
2
This example shows how to use vLLM for running offline inference
3
-with the correct prompt format on vision language models.
3
+with the correct prompt format on audio language models.
4
5
For most models, the prompt format should follow corresponding examples
6
on HuggingFace model repository.