A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 07:15 UTC
main
Fix underscores in dict keys passed via CLI (#19030)
Harry Mellor committed over 1 year ago
[CI/Build] Remove V0 LoRA test (#19066)
Jee Jee Li committed over 1 year ago
[doc] clarify windows support (#19088)
youkaichao committed over 1 year ago
[Doc] Update V1 user guide for embedding and enc-dec models (#19060)
Cyrus Leung committed over 1 year ago
[Misc] Update `WeightsMapper` for qwen2-vl/qwen2.5-vl (#19054)
Isotr0py committed over 1 year ago
[Doc] Add InternVL LoRA support (#19055)
Jee Jee Li committed over 1 year ago
Update docker docs with ARM CUDA cross-compile (#19037)
Michael Goin committed over 1 year ago
[v1][KVCacheManager] Rename BlockHashType to BlockHash (#19015)
Chen Zhang committed over 1 year ago
[Bugfix] Use cmake 3.26.1 instead of 3.26 to avoid build failure (#19019)
Lu Fang committed over 1 year ago
Reduce logs in CLI scripts and plugin loader (#18970)
Michael Goin committed over 1 year ago
[bugfix] small fix logic issue (#18999)
Reid committed over 1 year ago
Add tarsier model support (#18985)
汪志鹏 committed over 1 year ago
[V1] Support DP with Ray (#18779)
Rui Qiao committed over 1 year ago
[ROCm][Build] Clean up the ROCm build (#19040)
Gregory Shtrasberg committed over 1 year ago
[CPU][CI] Re-enable the CPU CI tests (#19046)
Li, Jiang committed over 1 year ago
Adding "LoRA Test %N" to AMD production tests (#18929)
Concurrensee committed over 1 year ago
[Bugfix][EP+DP] Use pplx-kernel internode instead of intranode (#19034)
Tyler Michael Smith committed over 1 year ago
[Doc] Remove duplicate TOCs during MkDocs migration (#19021)
Hyogeun Oh (오효근) committed over 1 year ago
[Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011)
Siyuan Liu committed over 1 year ago
add an absolute path for run.sh (#18258)
Calvin Chen committed over 1 year ago