@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 2, 03:30 UTC

main

[BugFix] Fix Humming MoE deploy error (#43100)

Alireza Dadgarnia committed 5 months ago

Migrate header files to torch stable abi (#44013)

Chris Leonard committed 5 months ago

[FlashAttention] Sync FA with upstream (#44065)

Matthew Bonanni committed 5 months ago

Support ModelOpt MXFP8 non-gated MoE (#42958)

TomerBN-Nvidia committed 5 months ago

← Newer Page 261 of 1120 Older →