[Bug] Fix `returned_lse` not Defined issue (#25106)

Wentao Ye committed about 1 year ago

[feat]: Create interface for model-specific M-RoPE (#24194)

Aziz committed about 1 year ago

[fix]: remove data type hardcoding from gptoss model implementation (#23807)

Nikhil Gupta committed about 1 year ago

[V0 Deprecation] Remove AsyncLLMEngine (#25025)

Woosuk Kwon committed about 1 year ago

[KV offload][1/N] Introduce an offloading component (#19848)

Or Ozeri committed about 1 year ago

[ROCm][AITER][Bugfix] Switch AITER to use PIECEWISE_AND_FULL compilation (#25104)

Rohan Potdar committed about 1 year ago

[ROCm][CI/Build] Use ROCm7.0 as the base (#25178)

Gregory Shtrasberg committed about 1 year ago

[spec decode] Fix MTP inference path for MiMo-7B model (#25136)

qizixi committed about 1 year ago

[Misc] Add codeowner for Transformers backend (#25180)

Harry Mellor committed about 1 year ago

Enable Allgather/ReduceScatter backend for NaiveAllToAll (#23964)

Shu Wang committed about 1 year ago

[Docs] Fix warnings in mkdocs build (continued) (#25163)

Hyogeun Oh (오효근) committed about 1 year ago

[New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872)

wang.yuqi committed about 1 year ago

feat(api): Return 503 on /health when engine is dead (#24897)

dongbo910220 committed about 1 year ago

[PERF] Add `conv1d` metadata to GDN attn (#25105)

Vadim Gimpelson committed about 1 year ago

[Kernel] Decouple Tile Size from Block Size in Triton Unified Attention Kernel (#21197)

jvlunteren committed about 1 year ago

[Misc] Add kv-connector label (#25156)

Nicolò Lucchesi committed about 1 year ago

Refactor dense FP8 tensor/channel/block utils and add CT FP8 block (#21404)

Michael Goin committed about 1 year ago

[Structured Output][Refactor] Move `apply_grammar_bitmask()` method from `ModelRunner` to structured output utils (#21999)

Shanshan Shen committed about 1 year ago

[Misc] Clean up flags in `vllm bench serve` (#25138)

Roger Wang committed about 1 year ago

[Bugfix][Mamba] - Fix Conv State Kernel FP32 Support (#24883)

Asaf Joseph Gardin committed about 1 year ago