@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 13, 05:45 UTC

main

[CI] Bug: Fix ci entrypoint pooling (#28684)

Wentao Ye committed 12 months ago

[Attention][Bugfix] Fix FA sink support (#28660)

Matthew Bonanni committed 12 months ago

[Performance][B200] silu_mul_quant: pack scales in int32 (#28358)

Varun Sundar Rabindranath committed 12 months ago

Rewrite C++ meta funcs to Python (#28595)

Jane (Yuan) Xu committed 12 months ago

← Newer Page 557 of 1120 Older →