[Refactor] Suppress SyntaxWarning from ast.literal_eval in tool parsers (#44346)

Flora Feng committed 5 months ago

[XPU] Add XPU block-scaled W8A8 fp8 path (#39968)

Xiaochang Wu committed 5 months ago

[Rust Frontend] Add /server_info to Rust frontend (#43942)

Xunzhuo committed 5 months ago

[SharedOffloadRegion] Align blocks to page-size (#43689)

Varun Sundar Rabindranath committed 5 months ago

[Attention][CPU] Standardize kv layout to blocks first (#44393)

Li, Jiang committed 5 months ago

[Perf] Improve multimodal item handling from O(n) to O(log n) per step (#44212)

Andy Lo committed 5 months ago

[Perf] Triton fast path for small CPU→GPU `swap_blocks_batch` in the offloading connector (#42212)

Itay Etelis committed 5 months ago

[XPU]fallback to TRITON_ATTN for vit attn on xpu when use float32 dtype (#43759)

Yan Ma committed 5 months ago

[Bugfix] Fix unstreamed tool call args dropped in Responses API streaming (#44348)

Flora Feng committed 5 months ago

[Bugfix] Update TrtLLM MoE routing methods (#44347)

Wei Zhao committed 5 months ago

[Doc] Update ViT CUDA graph interfaces (#44388)

Shanshan Shen committed 5 months ago

[Rust Frontend] Fix several hf chat template rendering issues (#44311)

Bugen Zhao committed 5 months ago

[Rust Frontend] Add dynamic LoRA endpoints (#43778)

Xunzhuo committed 5 months ago

[Rust Frontend] Add server router extension hook (#43774)

NolanHo committed 5 months ago

[KV Offloading] Enable HMA models for Tiering Offloading (#44287)

Varun Sundar Rabindranath committed 5 months ago

[Perf] Add tuned selective_state_update configs for H200 and RTX PRO … (#44251)

Majid committed 5 months ago

[ROCm][CI] Optimize ROCm Docker build: registry cache, DeepEP, and ci-bake script (#36949)

Andreas Karatzas committed 5 months ago

Enable perf_token_group_quant/_C_stable_libtorch for ROCm (#42758)

Charlie Fu committed 5 months ago

[Benchmark] Enable reasoning-model (thinking) benchmarking via `--chat-template-kwargs` for client-rendered datasets (#44244)

Albert Cheng committed 5 months ago

[Bugfix] fix crash in postprocess for null tool args (#43862)

William Rom committed 5 months ago