A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
main
[V0 Deprecation] Remove V0 MP executor (#25329)
Woosuk Kwon committed about 1 year ago
[V0 Deprecation] Remove from_seq_group methods (#25330)
Woosuk Kwon committed about 1 year ago
[Multi Modal][Performance] Fused Q,K's apply_rope in more models (#25005)
Wenlong Wang committed about 1 year ago
[V0 Deprecation] Remove V0 model runner base & simplify worker base (#25328)
Woosuk Kwon committed about 1 year ago
[Doc] improve test-pipeline.yaml documentation (#25305)
Huamin Li committed about 1 year ago
[V0 Deprecation] Remove V0 core (#25321)
Woosuk Kwon committed about 1 year ago
[CI] Skip tests failing on main (#25326)
Woosuk Kwon committed about 1 year ago
[Chore] Remove unused sampler in models (#25324)
Woosuk Kwon committed about 1 year ago
[V0 Deprecation] Remove V0 Output Processor (#25320)
Woosuk Kwon committed about 1 year ago
[V0 Deprecation] Remove LLMEngine (#25033)
Woosuk Kwon committed about 1 year ago
[Docs] Fix warnings in vllm/profiler and vllm/transformers_utils (#25220)
Michael Yao committed about 1 year ago
[V0 Deprecation] Enable the remaining multimodal tests in V1 (#25307)
Cyrus Leung committed about 1 year ago
[Core] Enable sharded state loader for V1 engine and enhance test coverage (#25308)
lirong committed about 1 year ago
[Model] Cleanup InternViT's data parallel implementation (#25306)
Isotr0py committed about 1 year ago
Generate _ModelInfo properties file when loading to improve loading speed (#23558)
Manoel Marques committed about 1 year ago
[Docs] Fix warnings in mkdocs build (continued) (#25042)
Wenlong Wang committed about 1 year ago
[CI Failure] Disable FlashInfer RoPE to unblock CI (#25299)
Michael Goin committed about 1 year ago
[V1] Support `LLM.apply_model` (#18465)
Cyrus Leung committed about 1 year ago
[Bugfix] Fix Qwen3-VL-MoE weight loading for EP (#25300)
Roger Wang committed about 1 year ago
[Hybrid Allocator] Support full attention with different hidden size (#25101)
Chen Zhang committed about 1 year ago