@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 13, 17:00 UTC

main

[Docs] Clean up README_TUNING.md (#28088)

Michael Yao committed about 1 year ago

[Bugfix] Fix Qwen3-Reranker-8B load (#28117)

wang.yuqi committed about 1 year ago

[CI]: Add LMCacheConnector Unit Tests (#27852)

Samuel Shen committed about 1 year ago

[Core] add support for reasoning parser plugins (#28075)

Walter Beller-Morales committed about 1 year ago

[misc] add vLLM Beijing Meetup (#28127)

Jiaju Zhang committed about 1 year ago

Enabling cooperative multi-gpu tests on multi-gpu nodes (#27986)

Alexei-V-Ivanov-AMD committed about 1 year ago

[BugFix] Support EP/DP + EPLB with MTP (#25311)

Ilya Markov committed about 1 year ago

add kimi reasoning parser (#28128)

bigmoyan committed about 1 year ago

← Newer Page 570 of 1120 Older →