[Models][Quantization] Add quantization configuration update in Voxtral model (#24122)

Alexandre Marques committed about 1 year ago

[Misc] Make timeout passable in init_distributed_environment (#24522)

Jonathan Berkhahn committed about 1 year ago

[Kernel] Flashinfer MLA (trtllm-gen) decode kernel integration (#21078)

Hanjie Qiu committed about 1 year ago

[Perf] Warmup FlashInfer attention during startup (#23439)

Michael Goin committed about 1 year ago

[gpt-oss] raise error for flashinfer backend without trtllm (#24482)

Chen Zhang committed about 1 year ago

[torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767)

Gregory Shtrasberg committed about 1 year ago

[v1] Add Whisper model support (encoder-decoder) (#21088)

Russell Bryant committed about 1 year ago

[CI] Fail subprocess tests with root-cause error (#23795)

Nick Hill committed about 1 year ago

[Bugfix] Enable FP8 KV cache for FlashInfer and Triton backend on non-sm100 GPUs (#24577)

Thien Tran committed about 1 year ago

[Misc] update log level debug to warning when process port is used by (#24226)

rongfu.leng committed about 1 year ago

[Core] Support configuration parsing plugin (#24277)

Xingyu Liu committed about 1 year ago

[Bugfix] Fix DeepEP config for DP4TP4 (#23619)

Ming Yang committed about 1 year ago

[Bugfix] fix modelopt exclude_modules name mapping (#24178)

tomeras91 committed about 1 year ago

[Logging] allow config logging stream (#24336)

Shiyan Deng committed about 1 year ago

[Doc] Add documentation for GLM-4.5 series models: tool-calling and reasoning parser (#24589)

Robin committed about 1 year ago

[Core] Split LoRA layers (#24574)

Jee Jee Li committed about 1 year ago

[CI] Fix tensorizer test assertion (#24545)

pwschuurman committed about 1 year ago

[Platform] Custom ops support for LMhead and LogitsProcessor (#23564)

zzhxxx committed about 1 year ago

[BugFix] `python collect_env.py` and `vllm collect-env` compatibility with uv venv (#24066)

Kay Yan committed about 1 year ago

[Docs] Fix warnings in `mkdocs build` (continued) (#24092)

Hyogeun Oh (오효근) committed about 1 year ago