A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 23:30 UTC
main
Consolidate Llama model usage in tests (#13094)
Harry Mellor committed almost 2 years ago
[Misc] Remove redundant statements in scheduler.py (#13229)
Wang Ran (汪然) committed almost 2 years ago
[Bugfix] Offline example of disaggregated prefill (#13214)
XiaobingZhang committed almost 2 years ago
[Bugfix][CI] Inherit codespell settings from pyproject.toml in the pre-commit-config (#13237)
Tyler Michael Smith committed almost 2 years ago
[Bugfix/CI] Turn test_compressed_tensors_2of4_sparse back on (#13250)
Tyler Michael Smith committed almost 2 years ago
[V1] Consolidate MM cache size to vllm.envs (#13239)
Roger Wang committed almost 2 years ago
[Kernel] Fix awq error when n is not divisable by 128 (#13227)
Jinzhen Lin committed almost 2 years ago
[ROCm] Avoid using the default stream on ROCm (#13238)
Gregory Shtrasberg committed almost 2 years ago
Revert "Add label if pre-commit passes" (#13242)
Harry Mellor committed almost 2 years ago
[Kernel][Bugfix] Refactor and Fix CUTLASS 2:4 Sparse Kernels (#13198)
Tyler Michael Smith committed almost 2 years ago
Optimize moe_align_block_size for deepseek_v3 (#12850)
Michael Goin committed almost 2 years ago
Add label if pre-commit passes (#12527)
Harry Mellor committed almost 2 years ago
[Frontend] Add `/v1/audio/transcriptions` OpenAI API endpoint (#12909)
Nicolò Lucchesi committed almost 2 years ago
[Bugfix] Missing Content Type returns 500 Internal Server Error (#13193)
Vaibhav Jain committed almost 2 years ago
[VLM] Separate text-only and vision variants of the same model architecture (#13157)
Cyrus Leung committed almost 2 years ago
[Misc] Qwen2.5-VL Optimization (#13155)
燃 committed almost 2 years ago
[V1][Core] Add worker_base for v1 worker (#12816)
Aoyu committed almost 2 years ago
[VLM] Merged multi-modal processor for Molmo (#12966)
Cyrus Leung committed almost 2 years ago
[V1] Clarify input processing and multimodal feature caching logic (#13211)
Roger Wang committed almost 2 years ago
[Frontend] Pass pre-created socket to uvicorn (#13113)
Russell Bryant committed almost 2 years ago