A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
main
[V0 Deprecation] Remove more V0 tests (#25117)
Woosuk Kwon committed about 1 year ago
[EPLB] Add EPLB support for hunyuan_v1 (#23078)
YiwenC committed about 1 year ago
[XPU] Whisper model support on XPU Platform (#25123)
Chaojun Zhang committed about 1 year ago
Mark prompt logprobs as incompatible with prompt embeds at API level (#25077)
Andrew Sansom committed about 1 year ago
[Model] enable data parallel for InternVL vision encoder (#23909)
YiwenC committed about 1 year ago
[Kernels] Overlap shared experts with combine instead of dispatch (#24254)
bnellnm committed about 1 year ago
toncao committed about 1 year ago
[Core][MM] Cleanup `MultiModalCache` (#25006)
Lukas Geiger committed about 1 year ago
[Docs] Clean up the contributing README (#25099)
Harry Mellor committed about 1 year ago
[MM Encoder] Apply DP ViT for Qwen3-VL model series (#24955)
Roger Wang committed about 1 year ago
[Kernels] Enable DeepGEMM by default (#24462)
bnellnm committed about 1 year ago
[V0 Deprecation] Skip PP test (#25128)
Woosuk Kwon committed about 1 year ago
[V0 Deprecation] Remove misc V0 tests (#25118)
Woosuk Kwon committed about 1 year ago
[V0 Deprecation] Remove V0 Tracing & Metrics tests (#25115)
Woosuk Kwon committed about 1 year ago
[V0 Deprecation] Remove V0 Engine tests (#25114)
Woosuk Kwon committed about 1 year ago
[Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537)
bnellnm committed about 1 year ago
[Bugfix] Fix accuracy issue for silu_mul + nvfp4 quant fusion kernel (#24833)
elvischenv committed about 1 year ago
Add a batched auto tune script (#25076)
Karan Goel committed about 1 year ago
[Bugfix] Refactor Flashinfer TRTLLM attention kernel selection logic (#24600)
elvischenv committed about 1 year ago
Disable failing GPT-OSS Eval (Blackwell) for now (#25107)
Michael Goin committed about 1 year ago