A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 03:15 UTC
main
[OpenVINO] Fixed Docker.openvino build (#11732)
Ilya Lavrenov committed almost 2 years ago
Fixed docker build for ppc64le (#11518)
Nishidha committed almost 2 years ago
Remove the duplicate imports of MultiModalKwargs and PlaceholderRange… (#11824)
WangErXiao committed almost 2 years ago
[Misc] sort torch profiler table by kernel timing (#11813)
Divakar Verma committed almost 2 years ago
[Bugfix] Fix image input for Pixtral-HF (#11741)
Cyrus Leung committed almost 2 years ago
[Doc] Group examples into categories (#11782)
Harry Mellor committed almost 2 years ago
[Bugfix] Significant performance drop on CPUs with --num-scheduler-steps > 1 (#11794)
Jie Fu (傅杰) committed almost 2 years ago
[Doc]Add documentation for using EAGLE in vLLM (#11417)
sroy745 committed almost 2 years ago
[Bugfix] update the prefix for qwen2 (#11795)
jiangjiadi committed almost 2 years ago
[optimization] remove python function call for custom op (#11750)
youkaichao committed almost 2 years ago
[Doc] Add note to `gte-Qwen2` models (#11808)
Cyrus Leung committed almost 2 years ago
[doc] update how pip can install nightly wheels (#11806)
youkaichao committed almost 2 years ago
[V1] Support audio language models on V1 (#11733)
Roger Wang committed almost 2 years ago
[doc] add doc to explain how to use uv (#11773)
youkaichao committed almost 2 years ago
[Bugfix] Comprehensively test and fix LLaVA-NeXT feature size calculation (#11800)
Cyrus Leung committed almost 2 years ago
[V1][Doc] Update V1 support for `LLaVa-NeXT-Video` (#11798)
Roger Wang committed almost 2 years ago
[CI][CPU] adding build number to docker image name (#11788)
Yuan committed almost 2 years ago
[Doc] Create a vulnerability management team (#9925)
Russell Bryant committed almost 2 years ago
fix init error for MessageQueue when n_local_reader is zero (#11768)
XiaobingZhang committed almost 2 years ago
[CI] Fix neuron CI and run offline tests (#11779)
Liangfu Chen committed almost 2 years ago