A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
main
[Misc] Clean up unnecessary E501 ignore (#26274)
Roger Wang committed about 1 year ago
[Benchmarking] Add disable_shuffle option for dataset loading (#26258)
Yasmin Moslem committed about 1 year ago
Bump actions/stale from 10.0.0 to 10.1.0 (#26272)
dependabot[bot] committed about 1 year ago
Fix per file ruff ignores related to line length (#26262)
Harry Mellor committed about 1 year ago
[CI][gpt-oss] Enable python tool tests in CI (#24315)
wuhang committed about 1 year ago
[MISC] Add heheda12345 to CODEOWNERS of vllm/config/cache.py (#26270)
Chen Zhang committed about 1 year ago
[Doc] Edited minor typo (#26266)
orangeng committed about 1 year ago
[V1] [Hybrid] Some additional clean-up in Mamba2 prefix caching (#26222)
Thomas Parnell committed about 1 year ago
[CI] Add comment about the single cudagraph capture size that is used (#26252)
Thomas Parnell committed about 1 year ago
[DOC] Update production-stack.md (#26177)
Elieser Pereira committed about 1 year ago
[CI] Add Blackwell LM Eval Small Models test to nightly (#26052)
Michael Goin committed about 1 year ago
Fix per file ruff ignores related to simplification (#26259)
Harry Mellor committed about 1 year ago
[NVIDIA] flashinfer TRTLLM attention prefill token limit (#25998)
Jason Li committed about 1 year ago
[CI] fix mamba kernel test (#26250)
Jiangyun Zhu committed about 1 year ago
Update `ruff` pre-commit hooks version (#26255)
Harry Mellor committed about 1 year ago
Fix per file ruff ignores related to typing (#26254)
Harry Mellor committed about 1 year ago
fix(tests): Resolve late binding of loop variable in assert message lambda (#26249)
ihb2032 committed about 1 year ago
Remove all cases of `fmt: on/off` (#26253)
Harry Mellor committed about 1 year ago
Remove all references to `yapf` as it's no longer used (#26251)
Harry Mellor committed about 1 year ago
Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247)
Harry Mellor committed about 1 year ago