A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 08:15 UTC
main
Bump actions/setup-python from 5.2.0 to 5.3.0 (#10209)
dependabot[bot] committed about 2 years ago
[core][distributed] add stateless process group (#10216)
youkaichao committed about 2 years ago
[Doc] fix doc string typo in block_manager `swap_out` function (#10212)
Yangcheng Li committed about 2 years ago
[Metrics] add more metrics (#4464)
harrywu committed about 2 years ago
[Bugfix][Hardware][CPU] Fix broken encoder-decoder CPU runner (#10218)
Isotr0py committed about 2 years ago
[V1] Allow `tokenizer_mode` and `trust_remote_code` for Detokenizer (#10211)
Roger Wang committed about 2 years ago
[LoRA][Kernel] Remove the unused libentry module (#10214)
Jee Jee Li committed about 2 years ago
[Hardware][CPU] Add embedding models support for CPU backend (#10193)
Isotr0py committed about 2 years ago
Bump the patch-update group with 5 updates (#10210)
dependabot[bot] committed about 2 years ago
[6/N] pass whole config to inner model (#10205)
youkaichao committed about 2 years ago
[doc] improve debugging code (#10206)
youkaichao committed about 2 years ago
[Doc] Fix typo error in vllm/entrypoints/openai/cli_args.py (#10196)
yansh97 committed about 2 years ago
[misc] improve cloudpickle registration and tests (#10202)
youkaichao committed about 2 years ago
[Misc] small fixes to function tracing file path (#9543)
Shawn Du committed about 2 years ago
[doc] Polish the integration with huggingface doc (#10195)
Yongzao committed about 2 years ago
[Doc] Fix typo error in CONTRIBUTING.md (#10190)
FuryMartin committed about 2 years ago
[ci][build] limit cmake version (#10188)
youkaichao committed about 2 years ago
[CI/Build] Split up models tests (#10069)
Cyrus Leung committed about 2 years ago
[Frontend][Core] Override HF `config.json` via CLI (#5836)
Krishna Mandal committed about 2 years ago
[Frontend] add `add_request_id` middleware (#9594)
cjackal committed about 2 years ago