@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 5, 22:15 UTC

main

Fix multi-node allreduce fusion (#38136)

Wei Zhao committed 7 months ago

[Renderer] Consolidate factory methods (#38218)

Cyrus Leung committed 7 months ago

[CI] Reorganize scoring tests (#38207)

wang.yuqi committed 7 months ago

← Newer Page 356 of 1120 Older →