A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 9, 07:30 UTC
main
[Doc] Enhance documentation around CPU container images (#32286)
Nathan Weinberg committed 9 months ago
[Misc] Clean up HIDDEN_DEPRECATED_METRICS after metric removal (#33323)
杨朱 · Kiki committed 9 months ago
Remove deprecated `reasoning_content` message field (#33402)
Harry Mellor committed 9 months ago
[Doc] [ROCm] Update Documentation to reflect v0.15.0 release (#33388)
vllmellm committed 9 months ago
[BUGFIX] Pixtral cannot be loaded with --limit-mm-per-prompt 0 (#33406)
Julien Denize committed 9 months ago
[Realtime API] Adds minimal realtime API based on websockets (#33187)
Patrick von Platen committed 9 months ago
[Misc] Replace Optional[X] with X | None syntax (#33332)
杨朱 · Kiki committed 9 months ago
[Refactor] Move MM item count validation outside of processor (#33396)
Cyrus Leung committed 9 months ago
fix: allow LFM2 MoE prefix caching (align) (#33376)
tianshu-Michael-yu committed 9 months ago
[model] Add support for openPangu7B-VL (#32449)
hujiaxin0 committed 9 months ago
Explicitly set `return_dict` for `apply_chat_template` (#33372)
Harry Mellor committed 9 months ago
[CI] Enable mypy import following for `vllm/spec_decode` (#33282)
Lucas Kabela committed 9 months ago
Move decode context parallel validationn to `ParallelConfig` (#33239)
Harry Mellor committed 9 months ago
[CI][AMD] Skip 4 GPUs testgroup ray tests (#33305)
Ryan Rock committed 9 months ago
[Models] Refactor Kimi-K2.5 weight loading (#33346)
Isotr0py committed 9 months ago
[BugFix] Disable async scheduling for Mamba prefix caching (#33352)
Harry Huang committed 9 months ago
Fix `tie_word_embeddings` for multimodal models in Transformers v5 (#33359)
Harry Mellor committed 9 months ago
[Model][Multimodal] Add explicit MusicFlamingo adapter (#32696)
Wang Haoyu committed 9 months ago
[Docs] Adding links and intro to Speculators and LLM Compressor (#32849)
Aidan Reilly committed 9 months ago
[Bugfix] Enable Triton MoE for FP8 per-tensor dynamic (#33300)
Michael Goin committed 9 months ago