A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
main
[Quantization] Automatically infer AWQ `modules_to_not_convert` field (#26909)
Isotr0py committed about 1 year ago
[ez] add uv lock to gitignore (#27212)
Andrew Xia committed about 1 year ago
[ROCm] enable some tests in entrypoints test groups on AMD (#26725)
Concurrensee committed about 1 year ago
[Feature][Quantization] auto_round support for mixed bits quantization (#23812)
Heng Guo committed about 1 year ago
[Bugfix][CI] Fix `Distributed Tests (4 GPUs)` async_sched+ray test (#27195)
Nicolò Lucchesi committed about 1 year ago
[Kernel][Model] Tune fused_moe Triton configs for Qwen3-30B A3/A3B on H100 (FP8/BF16) (#26268)
shivampr committed about 1 year ago
Nemotron Nano V2 VL + EVS Video Support (#27107)
Eugene Khvedchenya committed about 1 year ago
AArch64 CPU Docker pipeline (#26931)
ioana ghiban committed about 1 year ago
[Kernel] Accelerate solve_tril with TMA (#26746)
Jiangyun Zhu committed about 1 year ago
[LoRA] LoRA cuda graph specialization (#25914)
Andy Lo committed about 1 year ago
[Model][VLM] Support Bee-8B Model (#27012)
Yi Zhang committed about 1 year ago
Fix typo in ValueError message: use `kv_role` instead of `kv_disagg_role` (#27166)
Yongtao Huang committed about 1 year ago
Sergei Skvortsov committed about 1 year ago
[Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169)
Cyrus Leung committed about 1 year ago
[Chore] Separate out `vllm.utils.network_utils` (#27164)
iAmir97 committed about 1 year ago
output type conversion fix (#27159)
Jianyu Huang committed about 1 year ago
[Benchmark] Convenience script for multiple parameter combinations (#27085)
Cyrus Leung committed about 1 year ago
[Chore] Separate out hashing utilities from vllm.utils (#27151)
dongbo910220 committed about 1 year ago
[BugFix] Fix lazy imports involving outlines_core (#27158)
22quinn committed about 1 year ago
[Minor] Remove unused env variable (#27161)
Woosuk Kwon committed about 1 year ago