[Bugfix] Unset HF's default max_new_tokens for DiffusionGemma (#45417)

Martin Kukla committed 5 months ago

[Docs] Update the online serving docs. (#45676)

wang.yuqi committed 5 months ago

[ROCm][Doc] Add installation notes about python version requirement (#45671)

vllmellm committed 5 months ago

[XPU] skip UT test_with_ngram_gpu_spec_decoding (#44423)

Yejing Lai committed 5 months ago

[Bugfix][Rust Frontend] Make metrics respect --served-model-name (#45465)

Reid committed 5 months ago

[Rust Frontend] Support `parallel_tool_calls = false` (#44760)

FAUST committed 5 months ago

[Models] Fix MiMo v2.x QKV TP sharding + FP4 support (#45200)

Giancarlo Delfin committed 5 months ago

[Rust Frontend] Add external→internal request-id map for abort() (#45137)

Sahil Singh committed 5 months ago

[Bugfix][Rust] Sync EngineCoreReadyResponse with the Python dataclass (#45557)

Will Eaton committed 5 months ago

[Bugfix] Reject out-of-range temperature values in SamplingParams (#44965)

Peter Pan committed 5 months ago

[Feature][Frontend] Report multimodal token counts in usage.prompt_tokens_details (#45458)

Ting SUN committed 5 months ago

[Model] Remove XverseForCausalLM (#45638)

Tiezhen WANG committed 5 months ago

[Bugfix][V1] Split V2 model-runner attention groups on num_heads_q (#45564)

Roger Wang committed 5 months ago

Fix included router missing path for `FastAPI >=0.137` (#45629)

Roger Wang committed 5 months ago

[Frontend] Add Streaming Parser Engine and new Qwen3 Parser (#45413)

Ben Browning committed 5 months ago

[Bugfix][CI] Update Dockerfile dependency graph PNG (#45602)

Flora Feng committed 5 months ago

[CPU] Refine CPU attention frontend (#45391)

Li, Jiang committed 5 months ago

[Bugfix][CPU] Honor cgroup memory limit when computing KV cache size (#45086)

maobaolong committed 5 months ago

[XPU] Enable sequence parallel support for XPU (#38608)

Chaojun Zhang committed 5 months ago

[Bugfix] Stream Llama4 weight loading to avoid host-OOM with copy-returning loaders (#44645)

Noa Neria committed 5 months ago