A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 22:35 UTC
main
Add @patrickvonplaten as maintainer of mistral's related files. (#21928)
Patrick von Platen committed over 1 year ago
[Docs] Fix the example code of streaming chat completions in reasoning (#21825)
Hongsheng Liu committed over 1 year ago
[Doc] Update partial support (#21916)
Cyrus Leung committed over 1 year ago
[benchmark] add max-concurrency in result table (#21095)
Peter Pan committed over 1 year ago
[Model] Remove DSV2 unused code (#21903)
Jee Jee Li committed over 1 year ago
[Tests] Fixing bug inside MultiModalProfiler. (#21842)
Varun Vinayak Shenoy committed over 1 year ago
[CI] rollback lint-and-deploy pipeline using amd machine (#21912)
Kebe committed over 1 year ago
[Doc] Update Intern-S1 info (#21908)
Jee Jee Li committed over 1 year ago
[Misc] Remove redundant config definitions (#21891)
Cyrus Leung committed over 1 year ago
Update vLLM Benchmark Suite for Xeon based on 0.9.2 release (#21486)
Louie Tsai committed over 1 year ago
[Docs] Expand introduction to Ray in Multi-node deployment section (#21584)
Ricardo Decal committed over 1 year ago
[CI/Build] Fix pre-commit failure in docs (#21897)
Cyrus Leung committed over 1 year ago
Add @sighingnow as maintainer of qwen's related files. (#21895)
Tao He committed over 1 year ago
[XPU] use `ZE_AFFINITY_MASK` for device select on xpu (#21815)
Kunshang Ji committed over 1 year ago
[Frontend] Add LLM.reward specific to reward models (#21720)
wang.yuqi committed over 1 year ago
[Perf] Using `__nv_fp8_e4m3` instead of `c10::e4m3` for `per_token_group_quant` (#21867)
Wentao Ye committed over 1 year ago
[Bugfix] Actually disable processing cache when API server is scaled out (#21839)
Cyrus Leung committed over 1 year ago
[Bugfix] Fix comment typo of get_num_common_prefix_blocks() (#21827)
MingzhenHan committed over 1 year ago
Areeb Syed committed over 1 year ago
Expose PyTorch profiler configuration to environment variables (#21803)
Csrayz committed over 1 year ago