[compile] Clean up AOT compile bypass on evaluate_guards. (#33578)

Zhengxu Chen committed 9 months ago

[XPU][2/N] add support unquantized moe support for xpu (#33659)

Kunshang Ji committed 9 months ago

use ORJSONResponse when available to improve the efficiency of request process (#33548)

Augusto Yao committed 9 months ago

[XPU] remove common path warning log (#33769)

Kunshang Ji committed 9 months ago

[Metrics] Add labeled prompt token metrics for P/D disaggregation (#33290)

zhanqiuhu committed 9 months ago

[Hardware][AMD][CI] Refactor AMD tests to properly use BuildKite parallelism (#32745)

Matt committed 9 months ago

[Deprecation] Deprecate profiling envs (#33722)

Wentao Ye committed 9 months ago

[Deprecation] Remove `_get_data_parser` in MM processor (#33757)

Cyrus Leung committed 9 months ago

[Feature] Enable `TRITON_ATTN` for Batch Invariance (#33688)

Frank Wang committed 9 months ago

[Refactor] Remove unused dead code (#33718)

Wentao Ye committed 9 months ago

[Bugfix] Define router_logits_dtype for remaining MoE models (#33737)

Michael Goin committed 9 months ago

Save startup benchmark results as a list of values (#33629)

Huy Do committed 9 months ago

[MM] Align the prefix of MMEncoderAttention with Attention (#33750)

Shanshan Shen committed 9 months ago

[CPU] Split attention dispatch by head_dim alignment (#32161)

R3hankhan committed 9 months ago

[1/N] Initial Implementation of Parser for ResponsesAPI (#32712)

Andrew Xia committed 9 months ago

[Bugfix] Fix torchrun PP broadcast deadlock with async scheduling (#33701)

Isotr0py committed 9 months ago

[Frontend][4/n] Make pooling entrypoints request schema consensus | ScoreRequest (#33060)

wang.yuqi committed 9 months ago

[BugFix][Spec Decoding] Fix negative accepted tokens metric crash (#33729)

Nick Hill committed 9 months ago

[Dependency] Remove comments of ray in dependency files (#33351)

Wentao Ye committed 9 months ago

[Bugfix] Fix sparse MLA metadata building (#33579)

Matthew Bonanni committed 9 months ago