A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
[Fix] remove is_marlin param in benchmark_moe (#23286)
shixianc committed
Aug 20, 2025 at 15:04 UTC
c86af22f31838ee654c856279ac5110ae3fdb2cc
No changes.