A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
main
[Model][0/N] Improve all pooling task | clean up (#25817)
wang.yuqi committed about 1 year ago
Ignore large reformatting PRs in `git blame` (#26690)
Harry Mellor committed about 1 year ago
[Model] Add reasoning_parser and tool_parser for Ernie45 thinking (#25027)
CSWYF3634076 committed about 1 year ago
[Model] Fix Skywork R1V mlp (#26673)
Jee Jee Li committed about 1 year ago
docs: wrong command in structured_outputs README (#26677)
yihong committed about 1 year ago
[FIX] Throwing an exception when the model does not support pool tasks (#25840) (#25855)
yyzxw committed about 1 year ago
[Bugfix][Core]Fix block table out-of-range issue in priority scheduling (#26661)
quanliu committed about 1 year ago
[Misc] cache result of disable_inplace (#26666)
bnellnm committed about 1 year ago
[CI/Build] Add tool to build vllm-tpu wheel (#19165)
Michael Goin committed about 1 year ago
[easy] fix pre commit error on trunk (#26665)
Huamin Li committed about 1 year ago
[Models][Qwen3VL] Speedup `fast_pos_embed_interpolate` (#26647)
Lukas Geiger committed about 1 year ago
[Feature] Add support for naver/splade-v3 (BERT-based sparse embedding model) (#26339)
gjgjos committed about 1 year ago
Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633)
Harry Mellor committed about 1 year ago
[Bugfix] Fix GPU_ID issue in test script (#26442)
Chendi.Xue committed about 1 year ago
[Bugfix][DCP] Set default CUDAGraphMode to PIECEWISE for DCP (#26574)
Jaya Yuan committed about 1 year ago
[Bugfix][CI/Build] Fix failing Mteb CI (#26638)
Isotr0py committed about 1 year ago
wang.yuqi committed about 1 year ago
[PERF] [Qwen3-next] Speed up gated RMSNorm (#26207)
Vadim Gimpelson committed about 1 year ago
Add @noooop to codeowner for pooling models (#26652)
wang.yuqi committed about 1 year ago
[EPLB] Support ernie4.5-moe (#22100)
Haisheng Chen committed about 1 year ago