A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 09:30 UTC
main
[CI/Build] Add Model Tests for PixtralHF (#9813)
Michael Goin committed about 2 years ago
[Frontend] Chat-based Embeddings API (#9759)
Cyrus Leung committed about 2 years ago
[Doc] Update multi-input support (#9906)
Cyrus Leung committed about 2 years ago
[torch.compile] Adding torch compile annotations to some models (#9876)
Yongzao committed about 2 years ago
[Model] Support bitsandbytes for MiniCPMV (#9891)
Michael Goin committed about 2 years ago
[torch.compile] rework test plans (#9866)
youkaichao committed about 2 years ago
[Bugfix] Fix layer skip logic with bitsandbytes (#9887)
Michael Goin committed about 2 years ago
[torch.compile] directly register custom op (#9896)
youkaichao committed about 2 years ago
[Bugfix][Frontend] Reject guided decoding in multistep mode (#9892)
Joe Runde committed about 2 years ago
[ci/build] Configure dependabot to update pip dependencies (#9811)
Kevin H. Luu committed about 2 years ago
[BugFix][Kernel] Fix Illegal memory access in causal_conv1d in H100 (#9838)
Mor Zusman committed about 2 years ago
sasha0552 committed about 2 years ago
[CI/Build] Adding a forced docker system prune to clean up space (#9849)
Alexei-V-Ivanov-AMD committed about 2 years ago
[CI/Build] Add Model Tests for Qwen2-VL (#9846)
Alex Brooks committed about 2 years ago
[Doc] Update Qwen documentation (#9869)
Jee Jee Li committed about 2 years ago
[Misc] Remove deprecated arg for cuda graph capture (#9864)
Roger Wang committed about 2 years ago
[Model] Support quantization of Qwen2VisionTransformer (#9817)
Michael Goin committed about 2 years ago
Revert "[Bugfix] Use host argument to bind to interface (#9798)" (#9852)
Kevin H. Luu committed about 2 years ago
Guillaume Calmettes committed about 2 years ago
[torch.compile] upgrade tests (#9858)
youkaichao committed about 2 years ago