A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 5, 12:15 UTC
main
[Bugfix][Spec Decode] Fix extract_hidden_states for VLM models (#38987)
Aaron Batilo committed 7 months ago
[Quantization][Deprecation] Remove Petit NVFP4 (#32694)
Robert Shaw committed 7 months ago
Revert "[vLLM IR] gemma_rms_norm" (#38998)
Robert Shaw committed 7 months ago
[vLLM IR] gemma_rms_norm (#38780)
Xiaoshuang Wang committed 7 months ago
[Perf][GDN] Align TMA usage with upstream FLA (#38981)
Artem Perevedentsev committed 7 months ago
[IR][RmsNorm] pass None if not has_weight (#38961)
Linkun committed 7 months ago
[Bugfix][CPU] Fix macOS compatibility broken by #36487 (#38970)
Ziming Qi committed 7 months ago
Refactor Arctic loading to use AutoWeightsLoader (#38955)
lalit10 committed 7 months ago
[Bugfix] Fix DSV32 weight loading (#38870)
Yongye Zhu committed 7 months ago
[ROCm][CI] Fix ROCm Dockerfile conftest generation for older Docker parsers (#38959)
Andreas Karatzas committed 7 months ago
[Bug] Fix workspace manager `_current_workspaces` size (#38853)
Wentao Ye committed 7 months ago
[Bug] Fix compile error for `swap_blocks_batch` in CUDA 13 (#38915)
Wentao Ye committed 7 months ago
[Bugfix][LoRA] Fix missing in_proj_z in Qwen3_5ForConditionalGenerati… (#38927)
elenalil-aws committed 7 months ago
[ROCm][CI] Minor missing import patch (#38951)
Andreas Karatzas committed 7 months ago
[ROCm][CI] Added back missing common deps (#38937)
Andreas Karatzas committed 7 months ago
[ci] Remove soft fail for AMD image build job (#38941)
Kevin H. Luu committed 7 months ago
Removed GPU state confirmation and cleanup steps. (#38238)
Divin Honnappa committed 7 months ago
Remove MQ multi-node tests (#38934)
Jeffrey Wang committed 7 months ago
[Model Runner V2] Add config validation for not-yet-supported features (#38758)
Nick Hill committed 7 months ago
[Bugfix] Re-enable Renormalize routing for TRT-LLM MoE experts (#38859)
yzong-rh committed 7 months ago