[Refactor] Remove useless syncwarp (#30510)

Wentao Ye committed 11 months ago

[Perf] Optimize deepgemm experts initialization, 3.9% TTFT improvement (#30494)

Wentao Ye committed 11 months ago

[Docs][CPU backend] Add pre-built Arm CPU Docker images (#30491)

ioana ghiban committed 11 months ago

[Core] Whisper Enable Encoder Batching (#29421)

Nicolò Lucchesi committed 11 months ago

[BugFix][MM]support VLLM_RANDOMIZE_DP_DUMMY_INPUTS (#30472)

Xingyu Liu committed 11 months ago

Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389)

Harry Mellor committed 11 months ago

[compile] Stop one-off setting enable_aot_compile and use context manager instead. (#30503)

Zhengxu Chen committed 11 months ago

[Misc] Add mcp to requirements (#30474)

Ye (Charlotte) Qi committed 11 months ago

[ROCm][Bugfix] Add MLACommonMetadata to allowed attention types for speculative decoding (#30430)

Andreas Karatzas committed 11 months ago

[Feature] AWQ marlin quantization support for fused moe with lora (#30442)

汪志鹏 committed 11 months ago

Add Eagle and Eagle3 support to Transformers modeling backend (#30340)

Harry Mellor committed 11 months ago

[IMPROVEMENT] Change MistralReasoningParser behavior (#30391)

Julien Denize committed 11 months ago

[CI] refine more logic when generating and using nightly wheels & indices, add cuda130 build for aarch64, specify correct manylinux version (#30341)

Shengqi Chen committed 11 months ago

Give pooling examples better names (#30488)

Harry Mellor committed 11 months ago

[Docs][CPU Backend] Add nightly and per revision pre-built Arm CPU wheels (#30402)

ioana ghiban committed 11 months ago

Make the `httpx` logger less annoying when Transformers v5 is installed (#30480)

Harry Mellor committed 11 months ago

[Misc] Improve error message for `is_multimodal` (#30483)

Cyrus Leung committed 11 months ago

[KVConnector] Add KV events to KV Connectors (#28309)

Martin Hickey committed 11 months ago

[Misc][PCP&DCP] relocate PCP feature check (#30050)

Qiu committed 11 months ago

Fix typo of endpoint name in CLI args docs (#30473)

Kenichi Maehashi committed 11 months ago