fix: stream Qwen3 tool call string arguments (#46351)

Rui Yin committed 4 months ago

[Doc] Fix typos, grammar, and broken commands across docs (#46398)

MichaelCaoo committed 4 months ago

[CI] Torch 2.11 flaky test_spec_decode_logprobs and gritlm tests (#45772)

Micah Williamson committed 4 months ago

[Bugfix] Fix humming lm_head crash and FusedMoE weight_shape coercion (#46420)

Michael Goin committed 4 months ago

[DeepEP V2] Bound num_max_tokens_per_rank in do_expand=False (#46404)

Woosuk Kwon committed 4 months ago

[ROCm][CI] Only require q_scale==1.0 for fp8 query in RocmAttention (#46148)

stefankoncarevic committed 4 months ago

[CI] Add TP=4 requirement to `test_mixed_precision_model_accuracies` (#46161)

fxmarty-amd committed 4 months ago

[ROCm][Quantization][4/N] refactor quark_moe fp8 w/ oracle (#43721)

Bowen Bao committed 4 months ago

[Bugfix][V1][TurboQuant] Reserve workspace before CUDA graph capture (#44053)

Guipeng Zhang committed 4 months ago

Fix static actorder handling for compressed-tensors WNA16 MoE (#41161)

ZewenShen-Cohere committed 4 months ago

[ROCm][CI] Increase the max wait time for server startup (#46417)

Charlie Fu committed 4 months ago

[ROCm][CI] Purging away redundant test group definitions (#46418)

Andreas Karatzas committed 4 months ago

[CI] Fix CPU-Multi-Modal Model Tests timeout by adding a 4th shard (#46388)

Tyler Michael Smith committed 4 months ago

[CI][ROCm] Restrict MLA cross-layer KV cache test to supported backends on ROCm (#46401)

Aarushi Jain committed 4 months ago

[CI] Add DGX Spark GPQA smoke test (#39541)

Michael Goin committed 4 months ago

[Bugfix] FusedMoE: coerce shape-(1,) per-tensor scales to 0-D scalar … (#43362)

Varshith committed 4 months ago

[Kernel][Performance] Add FlashInfer cutedsl NVFP4 GEMM backend (#42235)

Mohammad Miadh Angkad committed 4 months ago

[ROCm][CI] Query total device memory via amdsmi to avoid HIP init (#46141)

stefankoncarevic committed 4 months ago

[Bugfix][KVConnector] Fix SimpleCPUOffloadConnector GPU->CPU store race (#46278)

Saddss committed 4 months ago

[MRV2] Generalize use of `WhisperModelState` (#46096)

Nick Hill committed 4 months ago