[Bugfix][MLA] Fix LSE log-base mismatch in DCP + FlashInfer MLA decode (#47079)

Summer Yang committed 4 months ago

[ROCm][CI] Make tests/v1/shutdown an importable package (#47085)

peizhang56 committed 4 months ago

[ROCm][CI] Move LM Eval Large Models (8 GPUs) to mi300 pool (#47094)

peizhang56 committed 4 months ago

[Rust Frontend] Add static HTTPS and mTLS support for HTTP and gRPC (#45890)

Tahsin Tunan committed 4 months ago

[GDN] Improve kkt kernel of CuteDSL prefill backend (#46346)

Thien Tran committed 4 months ago

[Bugfix][Reasoning] Fix thinking_token_budget not enforced on re-entry after forced end (#43757)

Ashwin Giridharan committed 4 months ago

[KVTransfer] MultiConnector: merge kv_transfer_params dicts across connectors (#46777)

weishu committed 4 months ago

[Bug] Fix sparse attention issue for GLM5.2 non-torch compile path (#47083)

Wentao Ye committed 4 months ago

[ROCm][CI] Use spawn around the threaded OTLP test (#47003)

Andreas Karatzas committed 4 months ago

[CI][Bugfix] Add cohere_melody to ROCm test requirements (#47072)

peizhang56 committed 4 months ago

[ROCm][DeepEP] Stabilize high-throughput DBO for DP+EP (#46990)

Andreas Karatzas committed 4 months ago

[ROCm][CI] Make memory sampling less racy in tests and sleep mode (#45490)

Andreas Karatzas committed 4 months ago

[ROCm][CI] Soft Fail `Spec Decode Ngram + Suffix` and `Entrypoints Integration (LLM)` AMD Mirrors (#47067)

Micah Williamson committed 4 months ago

Fix FA4 dynamic_causal for full attention layers (#46659)

Matthew Bonanni committed 4 months ago

Fix transient dependency issues caused by `requirements/common.txt` (#47015)

Harry Mellor committed 4 months ago

[Model Runner V2] support mamba hybrid models align prefix cache (#42406)

zhrrr committed 4 months ago

Support DCP with FlashInfer MLA (#43729)

Woosuk Kwon committed 4 months ago

[XPU] [RMSNorm] revert weightless change on xpu (#46987)

zofia committed 4 months ago

[ModelRunner V2] Simplify recent UnlimitedOCR-related changes (#46975)

Nick Hill committed 4 months ago

[Bugfix] Fix DeepseekV2Model hidden_size (#46986)

Jee Jee Li committed 4 months ago