@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 11, 23:45 UTC

main

Abstract eplb algo (#26471)

Mercykid-bash committed 11 months ago

[Bugfix] Fix FP8 MoE LoRA (#29890)

Jee Jee Li committed 11 months ago

Delete HF version of Phi 4 MM (#30049)

Harry Mellor committed 11 months ago

[release] install regex (#30008)

Kevin H. Luu committed 11 months ago

← Newer Page 523 of 1120 Older →