[compile] Improve error message during artifacts load failure. (#35115)

Zhengxu Chen committed 9 months ago

[Linear Attention] fix bug for linear attention + prefix caching + reset_prefix_cache (#35157)

Chen Zhang committed 9 months ago

Remove requirement to use `--hf-overrides` for `DeepseekVLV2ForCausalLM` (#35203)

Harry Mellor committed 9 months ago

[Bugfix] Fix AttributeError when passing StructuredOutputsParams to CompletionRequest (#35237)

pks committed 9 months ago

[Responses][CI] Filter negative token IDs in schema fuzz test to avoid 500 errors (#35231)

Andreas Karatzas committed 9 months ago

[FIX] fused moe with lora shared expert dual stream (1.07x otps) (#34933)

Jhao-Ting Chen committed 9 months ago

[ROCm]: Enable customop and rope+kvcache fusion for AITER RoPE (#35180)

Rohan Potdar committed 9 months ago

[Responses] Decouple SSE event helpers from Harmony context (#35148)

Flora Feng committed 9 months ago

[Frontend] Use init_app_state and FrontendArgs in run_batch (#32967)

Pooya Davoodi committed 9 months ago

[Core] Cleanup engine pause/sleep logic (#34528)

Nick Hill committed 9 months ago

[Bugfix] Fix expert_ids padding values in moe_align_block_size kernel (#35161)

Xin Yang committed 9 months ago

Adding Nemotron fp8 Triton MoE Config (#34674)

yugong333 committed 9 months ago

Convert wvSplitKQ to 16x16 MFMA in prep for mi4xx. (#34100)

Hashem Hashemi committed 9 months ago

[Bug][DSV3.2] Always prepare metadata for DeepGEMM Sparse Attention (#35075)

Benjamin Chislett committed 9 months ago

[CI] Fix Distributed Tests (#35236)

Robert Shaw committed 9 months ago

[ROCm][CI] Added MI325 mirrors (#34923)

Andreas Karatzas committed 9 months ago

[Model][Spec Decode] Nemotron-H MTP and Mamba Speculative Decoding Support (#33726)

Benjamin Chislett committed 9 months ago

Add @MatthewBonanni to CODEOWNERS (#35207)

Matthew Bonanni committed 9 months ago

Revert "[CI/Build] Remove redundant OpenTelemetry pip install from CI configs" (#35211)

Lucas Wilkinson committed 9 months ago

[CI/Build] Fix kernels test location (#35205)

Cyrus Leung committed 9 months ago