A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 10, 17:45 UTC
main
[CI Failure] Disable B200 tests while runner is broken (#31732)
Michael Goin committed 10 months ago
[Frontend] [Doc] Exclude log deltas feature (#30322)
Kevin Šuc committed 10 months ago
[v1] Add encoder-only/cross attention support to Triton Attention backend (#31406)
Isotr0py committed 10 months ago
[Model] Let more models to support the score template. (#31335)
wang.yuqi committed 10 months ago
[platform] Support additional forward context for OOT (#31674)
zzzzwwjj committed 10 months ago
[KVconnector][LMCache] remove the import of legacy LMCache code (#31704)
Yihua Cheng committed 10 months ago
[LoRA] LoRA PDL improvement (#31660)
Jee Jee Li committed 10 months ago
[Model] Enable LoRA support for BLIP2 (#31620)
Qiping Pan committed 10 months ago
[ROCM] Reorder arguments and rename parameters for rope_cached_thd_positions_2c_fwd_inplace (#29993)
Tres committed 10 months ago
[CI] Bump sentence-transformer from 3.2.1 to 5.2.0 (#31664)
wang.yuqi committed 10 months ago
[Frontend] [Bugfix] respect server-level default chat template kwargs in reasoning parser (#31581)
cjackal committed 10 months ago
[Bugfix] Fix EPLB state logging error (#31455)
Tyler Michael Smith committed 10 months ago
[log] enable max_log_len trim only when needed (#31482)
Ning Xie committed 10 months ago
Add chat prefix completion feature to DeepSeek v3.2 (#31147)
CHENYUE committed 10 months ago
[CI Failure] Fix NomicBert max_model_len validation (#31662)
wang.yuqi committed 10 months ago
[Misc] Various code simplifications (#31666)
Nick Hill committed 10 months ago
[Platform] Deprecate seed_everything (#31659)
wangxiyuan committed 10 months ago
[CI/Build] Revive skipped reward models e2e test (#31665)
Isotr0py committed 10 months ago
[Minor] Small pooler output processing optimization (#31667)
Nick Hill committed 10 months ago
[Bugfix] Fix AttributeError: 'Stream' object has no attribute 'dp_size' (#31663)
Jee Jee Li committed 10 months ago