[XPU] Alias is_current_stream_capturing to XPU in cuda wrapper (#50526)

Sundaresan G committed 3 months ago

[Bugfix][Spec Decode] Fix EAGLE3 DeepSeek draft crash on non-YaRN rope configs (#51092)

qizixi committed 3 months ago

[Bugfix][EC Connector] Don't stop an encoder-instance request before its images are encoded (#50275)

Tianyu Guo committed 3 months ago

[Bugfix] Skip Qwen3 deepstack buffers without vision (#49397)

Wei-Cheng (Wayne) Chiu committed 3 months ago

[Bugfix][Model] Gemma3n/Gemma4: pad variable-length audio batches (#50958)

TrainToGPB committed 3 months ago

[Kernel] Batch invariant NVFP4 MoE using cutlass (#40372)

Jakub Zakrzewski committed 3 months ago

[KV Offload] Support partial secondary-tier load results (#50321)

Moein Khazraee committed 3 months ago

[R3] Unify routed expert shape configuration (#50940)

aoshen02 committed 3 months ago

[CPU] Enable tcmalloc for s390x (#50841)

Rehan Khan committed 3 months ago

[BUGFIX][Quant]Fix test_kv_scale_reload failed (#50405)

Yejing Lai committed 3 months ago

[Model] Fix Kimi-K3 MLA with disabled context parallelism (#50404)

Dr Tasos Varoudis committed 3 months ago

[ROCm][CI] Add aiter per-token FP8 quant roundtrip and RMSNorm determinism tests (#50905)

Divakar Verma committed 3 months ago

Prune redundant tests points in `correctness_e2e/[test_sequence_parallel,test_async_tp]` (#51068)

Michael Goin committed 3 months ago

[ROCm] Restore Inkling MTP backend parity (#50806)

Andreas Karatzas committed 3 months ago

[CI] Prune `PyTorch Compilation Unit Tests` (#51069)

Michael Goin committed 3 months ago

[CI][Bugfix] Fix `test_shutdown_on_engine_failure` startup deadlock (#51050)

Nick Hill committed 3 months ago

[ROCm]: Bump torch 2.12, triton 3.7, torchaudio, torchvision (#50607)

Rohan Potdar committed 3 months ago

[CI] Add run-all comment commands (#51087)

Kevin H. Luu committed 3 months ago

[BugFix][Mooncake] Use global data_parallel_index for the DP engine index (#48061)

Yifan Qiao committed 3 months ago

[CI] Detect and fail evals on when NaNs appear in logits (#50323)

Tyler Michael Smith committed 3 months ago