@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[Bugfix]: Qwen3 Coder Tool Parser (#23099)

Yiheng Xu committed about 1 year ago

[Docs] Fix math rendering in docs (#23676)

Harry Mellor committed about 1 year ago

fix pynccl reduce_scatter (#23648)

yzds committed about 1 year ago

[Compile] Fix Cmake Warning (#23689)

Wentao Ye committed about 1 year ago

[V1][P/D]P2pNcclConnector supports flashinfer (#23536)

Zhonghua Deng committed about 1 year ago

Enhance the pre-notification policy (#23532)

Huzaifa Sidhpurwala committed about 1 year ago

[doc] Hybrid KV Cache Manager design doc (#22688)

Chen Zhang committed about 1 year ago

← Newer Page 674 of 1120 Older →