A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 2, 09:45 UTC
main
[Misc] added unit tests for the core pooling methods (#43818)
Taneem Ibrahim committed 5 months ago
docs: clarify ITL acronym in optimization docs (#43922)
Chunyang Wen committed 5 months ago
Add vLLM library info to Hugging Face Hub requests (#43857)
Lucain committed 5 months ago
[Bugfix][CPU] Remove invalid extra deps (#43977)
Li, Jiang committed 5 months ago
Skip docs build if PR doesn't affect docs (#43972)
Harry Mellor committed 5 months ago
[Bugfix] Corrupted MLA + linear attention (#43961)
Thien Tran committed 5 months ago
[ROCm][Perf] DSv3.2 MI355X TP4 decode-step orchestration cleanup (3 micro-opts) (#42982)
frida-andersson committed 5 months ago
[Bugfix] [ROCm] [DSV4] Fix AITER MXFP4 MoE weight loading and shuffle… (#42595)
MHYangAMD committed 5 months ago
[Kernel][ROCm] Native W4A16 kernel for AMD RDNA3 (gfx1100) — fp16 + bf16 (#41394)
JartX committed 5 months ago
[Bugfix] Fix Step3 pipeline parallel KeyError for residual tensor (#37622)
Joaquín Mondéjar committed 5 months ago
[CI] Nixl+SimpleCPUOffloadingConnector unit tests (#43871)
Nicolò Lucchesi committed 5 months ago
[XPU] support MTP of gdn attention (#43565)
Qiming Zhang committed 5 months ago
[CI][ROCm] Don't skip MoRI-IO Connector tests (#43703)
Simon Danielsson committed 5 months ago
[XPU] fix xpu install document triton-xpu version (#43947)
Kunshang Ji committed 5 months ago
[ROCm][CI] Fix AITER unified attention for encoder-decoder cross-attention (#43945)
Andreas Karatzas committed 5 months ago
[Frontend]Responses API supports chat_template_kwargs (#43761)
Chauncey committed 5 months ago
[ROCm][DSv4] Remove device pipeline stall in sparse attention (#43898)
kliuae committed 5 months ago
[CPU Backend] CPU top-k and top-p sampling kernels using Triton (#43633)
Tianmu Li committed 5 months ago
[XPU] add gelu_tanh to xpu moe backend supported activations (#42822)
Yintong Lu committed 5 months ago
[CI] Separate non-root smoke tests from image build step (#43712)
Kevin H. Luu committed 5 months ago