[Bugfix] Fix get_open_port() livelock on DP-reserved ports and cover get_open_ports_list (#50965)

aoshen02 committed 3 months ago

[Bugfix][KV-transfer] MoRIIO: per-layer READ-completion barrier in wait_for_layer_load (#48534)

limeward committed 3 months ago

[PD][NixlPush][Bugfix] Fix prefix caching (#48758)

Nicolò Lucchesi committed 3 months ago

[Model] Enable Qwen3.8 for AMD Rocm (#50068)

haic0 committed 3 months ago

[Bugfix] Skip fetching revision for model when model and weights_model are different (#51260)

music-dino committed 3 months ago

Fix ROCm architecture import on non-ROCm platforms (#51357)

Xiaochang Wu committed 3 months ago

feat: extended EPLB support for Mistral Large 3 and additional MoE backends (#48355)

Julien Debache committed 3 months ago

[XPU] quick fix online quantization UT break (#51365)

Yan Ma committed 3 months ago

[Misc] Add and enable Triton kernel unit tests on XPU (#45694)

pmanczak committed 3 months ago

[PD][PushConnector] Record last activity of remotes to allow clean up of stale ones (#50234)

Nicolò Lucchesi committed 3 months ago

[Bugfix][Platform] Stop re-initializing NVML on every device-capability check (fixes #50381) (#50393)

Sebastian Woo committed 3 months ago

[Bugfix][Quantization] Fix dynamic INT8 W8A8 MoE config being built as W8A16 (#50833)

Hank_ committed 3 months ago

[Refactor] Remove kernel dead code (#51051)

Wentao Ye committed 3 months ago

Support DeepSeek-V4 AMD Quark NVFP4 with emulation kernel (#47972)

jimmy-adams committed 3 months ago

[ROCm][CI] Loosen block-FP8 fused MoE test tolerance for large-K shapes (#48847)

stefankoncarevic committed 3 months ago

[Feat][Core] Add disk offloading support to SimpleCPUOffloadConnector (#49644)

Guanyi Chen committed 3 months ago

[rl] Stateful Trainer Send: NCCL + Sparse NCCL [3/N] (#50902)

Aaron Hao committed 3 months ago

[ROCm][Perf] Kimi-K3 Shard Latent MoE up-projection for ROCm path (#51253)

kliuae committed 3 months ago

[CI][XPU] Work around intermittent segfault in Intel XPU CI with VLLM_DISABLE_COMPILE_CACHE=1 (#51337)

Chaojun Zhang committed 3 months ago

[Bugfix] Fix Mamba all-mode CPU offload boundary alignment (#51100)

Qianxu Wang committed 3 months ago