[Benchmark] Auto-detect and correct client/server tokenizer mismatch for random dataset (#44708)

akii96 committed 5 months ago

[CI] Consolidate multimodal entrypoint tests. (#44819)

wang.yuqi committed 5 months ago

[CI/Build][CPU] Fix flaky CI image build failure and unexpected warnings (#44852)

Li, Jiang committed 5 months ago

[Connector] Remove `P2pNcclConnector` (#44854)

Nicolò Lucchesi committed 5 months ago

[CPU][Spec Decode] Warn about throughput loss when libiomp5 is not preloaded (#44419)

Jonathan Mamou committed 5 months ago

[XPU] Cap topk/topp Triton BLOCK_SIZE to 4096 to fix Top-p mask difference failures (#44470)

Chaojun Zhang committed 5 months ago

[Rust Frontend] Add /pause, /resume, /is_paused endpoints (#44499)

Sahil Singh committed 5 months ago

[BugFix] Use served model name in gemma4 audio-tower error message (#44828)

Sungjae Lee committed 5 months ago

[XPU][CI] Add more test cases in Intel GPU CI (#43663)

xiangdong committed 5 months ago

[ROCm][CI] Stabilizing teardown and timeout of flaky tests to prevent rare OOMs (#44761)

Andreas Karatzas committed 5 months ago

[ROCm][CI] Stage C mirrors (#42793)

Andreas Karatzas committed 5 months ago

[XPU][Minor] format moe kernel name and add in kernel list (#44771)

Yan Ma committed 5 months ago

[MM][CG] Simplify ViT CUDA graph interfaces (#44484)

Shanshan Shen committed 5 months ago

[XPU]feat: add DeepSeek-V4 XPU attention decode path (#42953)

Ma Jian committed 5 months ago

[Bugfix]: Fix assertion in MambaManager.allocate_slots() (#39562)

KANG Qihan committed 5 months ago

Added extra_repr() to pooler classes to improve debuggability (#44805)

Taneem Ibrahim committed 5 months ago

[Bugfix] Fix FunASR-Nano crash during initialization (#44215)

SunskyXH committed 5 months ago

[Kernel][Test] Make kernel tests for mamba dual-HW (CUDA + XPU) (#42736)

Agata Dobrzyniewicz committed 5 months ago

[1/N][KV-Cache Layout Refactor] Refactor DSV4 KV cache config construction (#44454)

Lucas Wilkinson committed 5 months ago

[ROCm][Kernel] Enable permute_cols for ROCm (#44674)

Charlie Fu committed 5 months ago