A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 13, 05:45 UTC
main
[ROCm] Bump up the version of amd-smi to 6.4.3 (#28680)
Sage Moore committed 12 months ago
[quantization][config] enable override existing quant_config (#28510)
Hank_ committed 12 months ago
Mirrored test group definitions for AMD (2025-11-11) (#28573)
Alexei-V-Ivanov-AMD committed 12 months ago
[KV Connector] Test async mode in scheduler tests (#28550)
Mark McLoughlin committed 12 months ago
[CI] Bug: Fix ci entrypoint pooling (#28684)
Wentao Ye committed 12 months ago
[Misc] Update CODEOWNERS for simon-mo and comaniac (#28675)
Simon Mo committed 12 months ago
[Bugfix] [CPU] bump torch to 2.9.0 for Darwin to fix segmentation fault (#27791)
Kebe committed 12 months ago
[Bugfix] Eliminate tuple inputs to submodules in graph partitioning (#28533)
Yanan Cao committed 12 months ago
[bugfix] correct local_chunk_len for DCP in reorg_kvcache with long context (#28526)
Qiu committed 12 months ago
[Perf] Support stream interval for reducing host overhead (#27869)
elvischenv committed 12 months ago
[Attention][Bugfix] Fix FA sink support (#28660)
Matthew Bonanni committed 12 months ago
[Bugfix] Fix validate model input for decoder models (#27099)
Yannick Schnider committed 12 months ago
[Performance][B200] silu_mul_quant: pack scales in int32 (#28358)
Varun Sundar Rabindranath committed 12 months ago
[TPU] patch TPU wheel build script to resolve metadata issue (#27279)
Johnny Yang committed 12 months ago
[BugFix] Ensure `EngineArgs.create_engine_config` is idempotent (#28515)
Nick Hill committed 12 months ago
Rewrite C++ meta funcs to Python (#28595)
Jane (Yuan) Xu committed 12 months ago
[Misc] Turn off encoder torch compile by default (#28634)
Roger Wang committed 12 months ago
Fix `get_num_experts` when config sets it explicitly to `None` (#28652)
Harry Mellor committed 12 months ago
[BugFix] DeepSeek-OCR: apply NoRepeatNGramLogitsProcessor to greedy path (#28617)
Yuanping Song committed 12 months ago
[CI Failure] Fix backend selection for encoder-only models (#28534)
Huamin Li committed 12 months ago