@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 4, 05:00 UTC

main

nixl refactor: new transfer design (#40731)

zhanqiuhu committed 6 months ago

[Bugfix][CI] Fix Disaggregated test area path (#41794)

Nicolò Lucchesi committed 6 months ago

[CPU] Add FP8 W8A16 linear support (#41186)

Yuwen Zhou committed 6 months ago

[ROCm][CI] Refine gating tests (#37243)

Andreas Karatzas committed 6 months ago

← Newer Page 303 of 1120 Older →