A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 13, 17:00 UTC
main
[Feature]: Add corrupted request metric to V1 metrics system. (#27306)
Snehlata committed about 1 year ago
[Docs] Add guide to debugging vLLM-torch.compile integration (#28094)
Richard Zou committed about 1 year ago
[Chore] Remove Nemotron-Nano-VL config copy (#28126)
Isotr0py committed about 1 year ago
[Hardware][IBM Z] Optimize s390x Dockerfile (#28023)
R3hankhan committed about 1 year ago
[Docs] Clean up README_TUNING.md (#28088)
Michael Yao committed about 1 year ago
[Bugfix] Fix Qwen3-Reranker-8B load (#28117)
wang.yuqi committed about 1 year ago
[Feature] Extend batch invariant torch.compile to B200 (#27856)
Paul Zhang committed about 1 year ago
[CI]: Add LMCacheConnector Unit Tests (#27852)
Samuel Shen committed about 1 year ago
[FlashInfer] Avoid FlashInfer block_size 16 + head_size 256 on blackwell (#27994)
Chen Zhang committed about 1 year ago
[Bugfix] vLLM should check Inductor config for compile cache enablement status (#27637)
gmagogsfm committed about 1 year ago
[Core] add support for reasoning parser plugins (#28075)
Walter Beller-Morales committed about 1 year ago
[Kernel] Fuse computation of g and beta for Gated Delta Net (#28095)
Jiangyun Zhu committed about 1 year ago
[misc] add vLLM Beijing Meetup (#28127)
Jiaju Zhang committed about 1 year ago
[Bugfix] Validate custom logits processor xargs for online serving (#27560)
Isotr0py committed about 1 year ago
[ROCm][MLA] Support block-size > 1 for AITER MLA backend (#27224)
Pleaplusone committed about 1 year ago
Enabling cooperative multi-gpu tests on multi-gpu nodes (#27986)
Alexei-V-Ivanov-AMD committed about 1 year ago
[BugFix] Support EP/DP + EPLB with MTP (#25311)
Ilya Markov committed about 1 year ago
[DCP] check return_lse for all layers in dcp (#27929)
Chen Zhang committed about 1 year ago
add kimi reasoning parser (#28128)
bigmoyan committed about 1 year ago
[XPU] Enable custom routing functions in IPEX for Llama4 (#28004)
Frost Mitchell committed about 1 year ago