A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
main
[Misc] Fix codeowners override for v1 sample and attention (#25037)
22quinn committed about 1 year ago
[CI/Build] Reorganize root-level V1 tests (#25767)
Cyrus Leung committed about 1 year ago
[CI/Build] Add timing to Model Executor Test (#25799)
22quinn committed about 1 year ago
[CI/Build] Consolidate model loader tests and requirements (#25765)
Cyrus Leung committed about 1 year ago
[Bugfix] Allow Only SDPA Backend for ViT on B200 for Qwen3-VL (#25788)
Wentao Ye committed about 1 year ago
[Multimodal][Speculative Decoding]Eagle Eagle3 mm support, enablement on qwen2.5vl (#22872)
WeiQing Chen committed about 1 year ago
Add flashinfer-build.sh and register precompiled cu128 wheel in Dockerfile (#25782)
Michael Goin committed about 1 year ago
Add option to restrict media domains (#25783)
Russell Bryant committed about 1 year ago
[Core] Don't count preempted tokens in prefix cache hit rate (#25787)
Zhuohan Li committed about 1 year ago
[Spec decode] automatically disable mm for text-only draft models (#25667)
Jonas M. Kübler committed about 1 year ago
[Bugfix] Optimize CpuGpuBuffer initialization (#25447)
Naman Lalit committed about 1 year ago
Kernel-override Determinism [1/n] (#25603)
Bram Wasti committed about 1 year ago
Reduce the Cuda Graph memory footprint when running with DBO (#25779)
Sage Moore committed about 1 year ago
[spec decode] Consolidate speculative decode method name for MTP (#25232)
qizixi committed about 1 year ago
[CI] Fix FlashInfer AOT in release docker image (#25730)
Michael Goin committed about 1 year ago
[V1] address post issues related to #20059 (part 1) (#23046)
fhl2000 committed about 1 year ago
[CI] Add E2E Blackwell Quantized MoE Test (#25723)
Michael Goin committed about 1 year ago
[Docs] Add Toronto Meetup (#25773)
Michael Goin committed about 1 year ago
[Bugfix] Improve GLM4 MoE Reasoning Parser's is_reasoning_end Condition (#25355)
Frank Wang committed about 1 year ago
[Doc]: improve CPU(x86) build-wheel-from-source section (#25617)
Clouddude committed about 1 year ago