A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 09:45 UTC
main
[Bugfix] Fix LoRA test (#18518)
Jee Jee Li committed over 1 year ago
[Bugfix][Model] Make Olmo2Model weight loading return loaded weights (#18504)
Shane A committed over 1 year ago
[BugFix][DP] Send DP wave completion only from `dp_rank==0` (#18502)
Nick Hill committed over 1 year ago
[Bugfix] Inconsistent token calculation compared to HF in llava family (#18479)
youngrok cha committed over 1 year ago
Intialize io_thread_pool attribute in the beginning. (#18331)
Rabi Mishra committed over 1 year ago
[CI] Fix race condition with StatelessProcessGroup.barrier (#18506)
Russell Bryant committed over 1 year ago
[MISC] update project urls in pyproject.toml (#18519)
Ning Xie committed over 1 year ago
[FalconH1] Fix output dtype in RMSNorm fallback path for Falcon-H1 (e.g. 0.5B) (#18500)
Dhia Eddine Rhaiem committed over 1 year ago
[Bugfix] Consistent ascii handling in tool parsers (#17704)
Sebastian Schoennenbeck committed over 1 year ago
[FEAT][ROCm] Upgrade AITER MLA v1 backend (#18338)
vllmellm committed over 1 year ago
Revert "[v1] Support multiple KV cache groups in GPU model runner (#17945) (#18459)
Mark McLoughlin committed over 1 year ago
[ROCm][Kernel][V1] Enable AMD Radeon GPU Custom Paged Attention on v1 (#17004)
Hosang committed over 1 year ago
[Misc] Update deprecation message for `--enable-reasoning` (#18404)
Hyogeun Oh (오효근) committed over 1 year ago
[Build] fix Dockerfile shell (#18402)
Kebe committed over 1 year ago
[Bugfix] Reduce moe_sum test size to avoid OOM (#18484)
bnellnm committed over 1 year ago
[Doc] fix arg docstring in linear layers (#18410)
GiantCroc committed over 1 year ago
Dhia Eddine Rhaiem committed over 1 year ago
[Bugfix][Failing Test] Fix test_events.py (#18460)
Rabi Mishra committed over 1 year ago
[Misc] refactor disaggregated-prefill-v1 example (#18474)
Reid committed over 1 year ago
[V1] Fix general plugins not loaded in engine for multiproc (#18326)
Yong Hoon Shin committed over 1 year ago