A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 02:00 UTC
main
[BugFix] Fix GGUF tp>1 when vocab_size is not divisible by 64 (#12230)
Nicolò Lucchesi committed almost 2 years ago
[AMD][Build] Porting dockerfiles from the ROCm/vllm fork (#11777)
Gregory Shtrasberg committed almost 2 years ago
Add quantization and guided decoding CODEOWNERS (#12228)
Michael Goin committed almost 2 years ago
Jinzhen Lin committed almost 2 years ago
[bugfix] catch xgrammar unsupported array constraints (#12210)
Cheng Kuan Yong Jason committed almost 2 years ago
[misc] add cuda runtime version to usage data (#12190)
youkaichao committed almost 2 years ago
fix: update platform detection for M-series arm based MacBook processors (#12227)
Işık committed almost 2 years ago
[Misc] Update CODEOWNERS (#12229)
Roger Wang committed almost 2 years ago
[CI] Pass local python version explicitly to pre-commit mypy.sh (#12224)
Chen Zhang committed almost 2 years ago
[Bugfix] Fix `HfExampleModels.find_hf_info` (#12223)
Cyrus Leung committed almost 2 years ago
[Misc] Pass `attention` to impl backend (#12218)
wangxiyuan committed almost 2 years ago
[V1] Remove `_get_cache_block_size` (#12214)
Chen Zhang committed almost 2 years ago
[core][bugfix] configure env var during import vllm (#12209)
youkaichao committed almost 2 years ago
[misc] print a message to suggest how to bypass commit hooks (#12217)
youkaichao committed almost 2 years ago
[Model] Upgrade Aria to transformers 4.48 (#12203)
Cyrus Leung committed almost 2 years ago
[CI/Build] Make pre-commit faster (#12212)
Cyrus Leung committed almost 2 years ago
[CI/Build] Remove dummy CI steps (#12208)
Cyrus Leung committed almost 2 years ago
[misc] add placeholder format.sh (#12206)
youkaichao committed almost 2 years ago
[Core] Interface for accessing model from `VllmRunner` (#10353)
Cyrus Leung committed almost 2 years ago
[Model] Add Qwen2 PRM model support (#12202)
Isotr0py committed almost 2 years ago