A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 12, 02:15 UTC
main
fix LoRA-related examples (#29956)
Iceber Gu committed 11 months ago
[CI/Build] Add MM code path to Examples Test (#29986)
Zhewen Li committed 11 months ago
enable multi-node in external launcher mode (#29833)
Xieyang Xu committed 11 months ago
Shengqi Chen committed 11 months ago
[Bugfix] Respect VLLM_CONFIGURE_LOGGING value (#28671)
Elizabeth Thomas committed 11 months ago
[Kernels] Remove BatchedTritonOrDeepGemmExperts and default fallback to Triton (#29929)
bnellnm committed 11 months ago
[CI] Fix re import error (#29973)
Wentao Ye committed 11 months ago
Fix LLMEngine.del dp_group cleanup condition (#29954)
Yongtao Huang committed 11 months ago
[Bugfix] Fix flashinfer ar+norm kernel not available issue (#29960)
elvischenv committed 11 months ago
[Performance][DP/EP] Add silu_mul_per_token_group_quant_fp8_colmajor kernel (#29470)
Varun Sundar Rabindranath committed 11 months ago
[Bugfix] Mistral tool parser streaming update (#19425)
avigny committed 11 months ago
[ROCm][CI] Fix v1/logits_processors failure on ROCm (#29927)
Micah Williamson committed 11 months ago
SigLIP example add chat_template (#29902)
Yu Jiaqi committed 11 months ago
[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163)
Lumis Chen committed 11 months ago
rasmith committed 11 months ago
[CPU Backend] [Doc]: Update Installation Docs for CPUs (#29868)
ioana ghiban committed 11 months ago
[GPU Backend] [Doc]: Remove duplicate statements on missing GPU wheels. (#29962)
ioana ghiban committed 11 months ago
[Frontend] supports deepseekv32 chat template (#29837)
Chauncey committed 11 months ago
[docker] Build CUDA kernels in separate Docker stage for faster rebuilds (#29452)
Amr Mahdi committed 11 months ago
[DOC] Add Arm to list of compute resouces providers (#29894)
Fadi Arafeh committed 11 months ago