@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 5, 14:45 UTC

main

[CI][ROCm] Add gpt-oss w4a8 in CI (#38292)

Bowen Bao committed 7 months ago

Triton MLA perf fixes (#33529)

Koushik Dutta committed 7 months ago

[Perf] fuse kernels in gdn (#37813)

Jiangyun Zhu committed 7 months ago

[Perf] DSV3.2 Indexer Fused Weights Projection (#38684)

Benjamin Chislett committed 7 months ago

← Newer Page 347 of 1120 Older →