A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 7, 17:45 UTC
main
[Bugfix] Fix Harmony preamble visibility in Responses API (#32114)
pushkar committed 9 months ago
[Bugfix] Gracefully disable AllReduceFusionPass on GPUs without multicast support (#35085)
haosdent committed 9 months ago
[XPU]Fix for Qwen-OMNI crash (#35249)
Chendi.Xue committed 9 months ago
[Misc][LoRA] Increase max vocab size limit to 258048 in logits processor (#34773)
Bhoomit committed 9 months ago
[Bugfix] Fix step3p5 reasoning with interleaved thinking (#34211)
Mario Hong committed 9 months ago
[Tests] Add GSM8k check to SpecDec E2E tests (#34772)
Benjamin Chislett committed 9 months ago
Joao Gante committed 9 months ago
Fix custom processors that use deleted behaviour for Transformers v5 (#35107)
Harry Mellor committed 9 months ago
[Bugfix][CPU] Fix basic unit tests failing in CPU platforms (#34677)
Yanwen Lin committed 9 months ago
[Doc] Suggest "--managed-python" flag when installing python using uv (#33069)
Yanwen Lin committed 9 months ago
[DOC][BugFix] Specfiy build dependency installation (#34513)
jonoillar committed 9 months ago
[Docs]Fix documentation formatting in architecture overview (#34679)
lichuang committed 9 months ago
docs: document committer proposal process in governance (#35225)
Simon Mo committed 9 months ago
[Perf] Add opt-in SM100 Oink RMSNorm custom-op path (#31828)
Laura Wang committed 9 months ago
[Perf] Optimize FP8 gemm of sm120. (#34424)
wenshuai committed 9 months ago
[XPU]Support CUDAGraph on XPU Platform (#34482)
Xinyu Chen committed 9 months ago
[Platform] Add current_platform.num_compute_units interface (#35042)
Kunshang Ji committed 9 months ago
remove cuda check in `top_k_top_p_triton` kernel (#35011)
Kunshang Ji committed 9 months ago
[Misc] Add shard_id validation for MergedColumnLinear (#35055)
Isotr0py committed 9 months ago
[Misc] Enable weights loading tracking for quantized models (#35074)
Isotr0py committed 9 months ago