A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 08:15 UTC
main
[CI/Build] Update CPU tests to include all "standard" tests (#5481)
Cyrus Leung committed about 2 years ago
[V1]Enable APC by default only for text models (#10148)
Roger Wang committed about 2 years ago
[Model] Expose size to Idefics3 as mm_processor_kwargs (#10146)
Isotr0py committed about 2 years ago
[Bugfix][XPU] Fix xpu tp by introducing XpuCommunicator (#10144)
Yan Ma committed about 2 years ago
[Misc] Fix typo in #5895 (#10145)
Cyrus Leung committed about 2 years ago
Add hf_transfer to testing image (#10096)
Michael Goin committed about 2 years ago
Fixes a typo about 'max_decode_seq_len' which causes crashes with cuda graph. (#9285)
Tao He committed about 2 years ago
[Doc] Move CONTRIBUTING to docs site (#9924)
Russell Bryant committed about 2 years ago
[Misc] Fix ImportError causing by triton (#9493)
Mengqing Cao committed about 2 years ago
[Bugfix] Add error handling when server cannot respond any valid tokens (#5895)
DearPlanet committed about 2 years ago
[Doc] Update FAQ links in spec_decode.rst (#9662)
whyiug committed about 2 years ago
[CI/Build] Give PR cleanup job PR write access (#10139)
Russell Bryant committed about 2 years ago
[V1] Prefix caching (take 2) (#9972)
Cody Yu committed about 2 years ago
[V1] Add all_token_ids attribute to Request (#10135)
Woosuk Kwon committed about 2 years ago
[Misc] report relevant env vars in collect_env.py tool (#9293)
Jiangtao Hu committed about 2 years ago
Bump actions/checkout from 4.2.1 to 4.2.2 (#9746)
dependabot[bot] committed about 2 years ago
Online video support for VLMs (#10020)
litianjian committed about 2 years ago
Bump actions/setup-python from 5.2.0 to 5.3.0 (#9745)
dependabot[bot] committed about 2 years ago
[CI/Build] Automate PR body text cleanup (#10082)
Russell Bryant committed about 2 years ago
[CI/Build] Add shell script linting using shellcheck (#7925)
Russell Bryant committed about 2 years ago