A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 15, 08:30 UTC
main
[Doc] fix list formatting (#18624)
David Xia committed over 1 year ago
[v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593)
Chen Zhang committed over 1 year ago
[Docs] Change mkdocs to not use directory urls (#18622)
Michael Goin committed over 1 year ago
Fix figures in design doc (#18612)
Harry Mellor committed over 1 year ago
Refactor pplx init logic to make it modular (prepare for deepep) (#18200)
youkaichao committed over 1 year ago
[Doc] Use a different color for the announcement (#18616)
Cyrus Leung committed over 1 year ago
[Doc] Fix markdown list indentation for MkDocs rendering (#18620)
Hyogeun Oh (오효근) committed over 1 year ago
[Bugfix][Build/CI] Fixup CUDA compiler version check for CUDA_SUPPORTED_ARCHS (#18579)
Simon Mo committed over 1 year ago
[Misc] add Haystack integration (#18601)
Reid committed over 1 year ago
Include private attributes in API documentation (#18614)
Harry Mellor committed over 1 year ago
[Bugfix] Fix transformers model impl ignored for mixtral quant (#18602)
Tristan Leclercq committed over 1 year ago
Fix examples with code blocks in docs (#18609)
Harry Mellor committed over 1 year ago
[CI/Build] Fix V1 flag being set in entrypoints tests (#18598)
Cyrus Leung committed over 1 year ago
Replace `{func}` with mkdocs style links (#18610)
Harry Mellor committed over 1 year ago
[Doc] Fix indent of contributing to vllm (#18611)
Hyogeun Oh (오효근) committed over 1 year ago
[CI] fix kv_cache_type argument (#18594)
Ning Xie committed over 1 year ago
[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to `requirements/cpu.txt` (#18542)
Kay Yan committed over 1 year ago
Add myself as docs code owner (#18605)
Harry Mellor committed over 1 year ago
[V0][Bugfix] Fix parallel sampling performance regression when guided decoding is enabled (#17731)
Madeesh Kannan committed over 1 year ago
[Bugfix][Model] Fix baichuan model loader for tp (#18597)
Mengqing Cao committed over 1 year ago