[Refactor] Chat Completions Harmony Refactor, non-streaming path. (#45171)

yzong-rh committed 5 months ago

[Bug] Fix test flashmla for DSv4 (#45052)

Wentao Ye committed 5 months ago

[Model] Remove InternLMForCausalLM registry alias (#45128)

Tiezhen WANG committed 5 months ago

[Bugfix] Fix Anthropic tool_use content handling dropping args (#45287)

Ben Browning committed 5 months ago

[Rust Frontend] Support continuous_usage_stats stream option (#43965)

Chao-Ju Chen committed 5 months ago

[Bugfix] Restrict FlashInfer cuDNN FP8 ViT attention gate to Blackwell (SM 100) (#45251)

wentian-byte committed 5 months ago

[Kernel][Helion][1/N] Add Helion kernel for per_token_group_fp8_quant (#36902)

Xiaohong (Sean) Chen committed 5 months ago

[Metrics] Scope unregister_vllm_metrics() to strictly "vllm:" metrics (#42331)

vraiti committed 5 months ago

[Attention] add triton diff-kv backend for mimo (#41797)

Jiangyun Zhu committed 5 months ago

[Core] Add kvcache watermark to reduce preemptions (#44594)

Nick Hill committed 5 months ago

[Bugfix] Fix NixlEPAll2AllManager's dependency on --enable-elastic-ep to function (#44422)

fangyuchu committed 5 months ago

[Doc][Attention] Fix MLA top-of-file comments (#37047)

wineandchord committed 5 months ago

[Bugfix] CohereModel.load_weights: skip modelopt _quantizer.* keys (#43495)

Kai K. committed 5 months ago

[Bugfix] Fix CPU memory leak related to not cleaning up old remotes data (#44424)

Nicolò Lucchesi committed 5 months ago

[Core] Release cached device memory under pressure on UMA GPUs during weight loading (#45179)

Michael Goin committed 5 months ago

[Docs] Add redirect for moved lmcache examples page (#45218)

Natalie Lin committed 5 months ago

Deprecations for v0.23 and v0.24 (#44992)

Harry Mellor committed 5 months ago

[PD][Core] Fix Mamba prefix cache hit rate in PD disaggregation (#44243)

zhanqiuhu committed 5 months ago

[Rust Frontend][Metrics] Export `vllm:lora_requests_info` from frontend (#45030)

Will Eaton committed 5 months ago

Hidden states extraction improvements (#43805)

Fynn Schmitt-Ulms committed 5 months ago