[ROCm][Bugfix] Fix Triton "out of resource: shared memory" Error In One-Shot LoRA MoE (#47209)

Micah Williamson committed 4 months ago

[ROCm][CI] Enable LoRA TP Distributed Test Group In AMD CI (#47193)

Micah Williamson committed 4 months ago

[CPU] Remove speculative decoding stream overrides from CPUModelRunner (#47162)

Jonathan Mamou committed 4 months ago

[Core] Pluggable sleep-mode backend abstraction (RFC #34303) (#44074)

Nils Matteson committed 4 months ago

[Rust Frontend] Add error context in tool parser failures (#46512)

Maria Guevara committed 4 months ago

fix: skip cooperative top-K on SM120 (#47164)

Gabriel Wu committed 4 months ago

[Attention][DSA] support dcp for FLASHINFER_MLA_SPARSE (#46076)

Jiangyun Zhu committed 4 months ago

[Hardware][AMD][CI] Toggle test coredumps on ROCm debug agent (#47222)

Matt committed 4 months ago

[Spec Decode] Support SWA + DFlash for MiMo (#46104)

Benjamin Chislett committed 4 months ago

[Bugfix][Frontend][gpt-oss] Return raw output when Harmony parser ends non-terminal (#47062)

achyuthan.s committed 4 months ago

[Distributed] Default FlashInfer allreduce to mnnvl on single node (#47219)

Woosuk Kwon committed 4 months ago

[GLM5] Support FlashMLA FP8 KV cache (Hopper & Blackwell) (#47090)

Woosuk Kwon committed 4 months ago

fix(reasoning): guard rfind in ernie45 streaming </response> branch (#46255)

hcl committed 4 months ago

[Refactor][GPT-OSS] Harmony Responses API Refactor to use HarmonyParser (#47185)

yzong-rh committed 4 months ago

[Perf] Restore zero-init of swizzled NVFP4 scale buffer to recover Blackwell decode throughput (#45739)

Albert Cheng committed 4 months ago

[Bugfix][Structured Outputs] Reject degenerate `structured_outputs` that crash EngineCore (#45346)

Ting SUN committed 4 months ago

[Bugfix][Frontend] Normalize constrained Harmony recipients (#45657)

tarjan1 committed 4 months ago

[Bugfix] Align OpenCV video metadata timeline (#47099)

VectorPeak committed 4 months ago

[Bugfix] compressed-tensors: allow int8 grouped WNA16 MoE on Marlin (#47154)

Joe Rowell committed 4 months ago

[Hardware][AMD][CI] Bump timeouts of various test groups on AMD CI (#47195)

Matt committed 4 months ago