[Reasoning][Structured Outputs] Add Command A plus tags for structural tags (#44588)

rishitdholakia13 committed 5 months ago

[DSV4] Move more ops out of eager breakpoint (#44561)

Woosuk Kwon committed 5 months ago

[Bugfix] Fix gemma4 crash on CPU: guard mem_get_info call (#44615)

adhithyamulticoreware committed 5 months ago

Remove KV cache scale boilerplate from model weight loading methods (#43167)

Harry Mellor committed 5 months ago

[BUG] Fix FP64 Gumbel precision coverage (#43150)

Tianyu Zhang committed 5 months ago

[Rust Frontend] Batch auto-abort requests by engine (#44591)

HueCodes committed 5 months ago

docs: fix tokenizer optimization typo (#44066)

Chunyang Wen committed 5 months ago

[NixlConnector] Initiate deprecation cycle for `kv_both` role (#43874)

Nicolò Lucchesi committed 5 months ago

[Rust Frontend] Support include_reasoning=false (#44391)

Chao-Ju Chen committed 5 months ago

[Bugfix] Update mistral tokenizer test for continue_final_message fix (#44622)

XuZhou committed 5 months ago

fix: pad dummy run query_start_loc (#44603)

Uranus committed 5 months ago

[Bugfix] Fix test_invocations flaky failure with newer openai SDK (#44618)

XuZhou committed 5 months ago

[Bugfix][Rust Frontend] Fix UTF-8 char-boundary panic in incremental detokenizer (#44620)

Ting SUN committed 5 months ago

Fix `LLM.wait_for_completion` output type docstring (#44617)

Vic Wen committed 5 months ago

[ROCm][perf] Use workspace manager for sparse indexer allocations (#41002)

Tuukka Sarvi committed 5 months ago

[ROCM] [FEAT] Integrate Aiter hipBLASLt GEMM online tuning (#40426)

Han Lin committed 5 months ago

[CI/Build] Disable CPU-Compatibility Tests (#44605)

Li, Jiang committed 5 months ago

[KVConnector][1/N] PP-aware handshake aggregation and intermediate-PP output plumbing (#43720)

qizixi committed 5 months ago

[Bugfix] Exclude vision embedder from quantization in Gemma4 Unified (#44571)

Luciano Martins committed 5 months ago

[DSV4] Refactor DeepseekV4Attention (#44569)

Woosuk Kwon committed 5 months ago