A high-throughput and memory-efficient inference and serving engine for LLMs
main
[Bugfix] Fall back to Pydantic loc for param in validation errors (#46038)
Muhammad Fawaz committed 4 months ago
[xpu] bump up vllm-xpu-kernels v0.1.10 and upgrade 2618 umd (#40367)
Kunshang Ji committed 4 months ago
[AMD][CI] Fix Language Models Test (Extended Generation) failures (#45509)
Oxana Korzh committed 4 months ago
[Docs] Update stale LMCache examples (#45762)
Samuel Shen committed 4 months ago
[DeepSeek-V4] Support TEP=16 for the block-FP8 shared expert (#46001)
Jeff (Junze) Ma committed 4 months ago
[bugfix]Indexer init skip and MTP TopK share for iteration (#45895)
Jared Wen committed 4 months ago
nv-nedelman-1 committed 4 months ago
[Cohere] Remove dead prepare_structured_tag override in Cohere parser (#46099)
Flora Feng committed 4 months ago
[Model Runner V2] Fix MRv2 memory leak test (#46095)
Wentao Ye committed 4 months ago
[Bugfix] [Parser] Fix empty tool block silently dropping subsequent content (#46091)
Ben Browning committed 4 months ago
[Perf] Remove unused loggers in `reasoning/` (#45988)
Ivy Xu committed 4 months ago
[Bugfix][KV Connector] Disable Mooncake TP put-striding when DCP > 1 (#45371)
Yifan Qiao committed 4 months ago
[KV Connector][Mooncake] Async lookup to reduce scheduler overhead (#45659)
Yifan Qiao committed 4 months ago
fix(anthropic): auto-detect template support for mid-conversation system messages (#46025)
MrFan committed 4 months ago
[MRV2] Make FP32 Gumbel sampling more accurate (#45996)
Woosuk Kwon committed 4 months ago
[CI Bug] Revert #42379 to fix CI `Multi-Modal Models (Extended Generation 1)` (#46070)
Wentao Ye committed 4 months ago
(security) Upgrade Starlette to >= 1.0.1 to fix CVE-2026-48710 (#45675)
Juan Pérez de Algaba committed 4 months ago
[Model Runner V2] Migration to support quantized model by default [5/N] (#44446)
Wentao Ye committed 4 months ago
[Bugfix][Quantization] Don't reject fp8_e5m2 KV cache for non-fp8 quantized checkpoints (#45040)
Ting SUN committed 4 months ago
[Bugfix] [Parser] Fix Qwen3 latent bug in partial params dropping values containing `<` (#46047)
Ben Browning committed 4 months ago