A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 9, 20:45 UTC
main
[Misc] Omit "disable NCCL for DP sync" startup log when not applicable (#32707)
Nick Hill committed 10 months ago
Bump Flashinfer to v0.6.1 (#30993)
elvischenv committed 10 months ago
[PluggableLayer][1/N] Define PluggableLayer (Fix ci) (#32744)
whx committed 10 months ago
[Quantization][Deprecation] Remove RTN (#32697)
Robert Shaw committed 10 months ago
[ROCm][Deepseekv3.2] Refactor Sparse Indexer as CustomOp (#29287)
Pleaplusone committed 10 months ago
[Quantization][Deprecation] Deprecate HQQ (#32681)
Robert Shaw committed 10 months ago
[Quantization][Deprecation] Remove `DeepSpeedFp8` (#32679)
Robert Shaw committed 10 months ago
[MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414)
Robert Shaw committed 10 months ago
Divakar Verma committed 10 months ago
[Model] Add Eagle2.5-8B Vision-Language Model support (#32456)
Kim Hee Su committed 10 months ago
[Bugfix] Force using spawn multiprocess method when it's the WSL platform (#32749)
Yanwen Lin committed 10 months ago
[Documentation] Fix typo in `docs/design/torch_compile_multimodal.md` (#32741)
Lucas Kabela committed 10 months ago
[Bugfix] Support HF sharded weights for Mistral3/Pixtral models (#32673)
RickyChen / 陳昭儒 committed 10 months ago
[Docs] Fix GitHub handle in governance process (#32582)
Paco Xu committed 10 months ago
[Bugfix] Fix Nemotron-Nano-v2-vlm static resolution (#32682)
Netanel Haber committed 10 months ago
Lucas Wilkinson committed 10 months ago
Added qwen3 vision language moe support for speculative decoding (#32048)
shanjiaz committed 10 months ago
Enable Eagle3 speculative decoding for Pixtral (LlavaForConditionalGeneration) (#32542)
gopalsarda committed 10 months ago
[Cleanup] Remove unused `KVConnectorModelRunnerMixin` methods (#32077)
Nick Hill committed 10 months ago
[Bugfix] Fix Granite Vision / Don't use Siglip Pooling Head Nested Models by Default (#32299)
Alex Brooks committed 10 months ago