@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 13, 14:30 UTC

main

[Log] update shm wait time msg (#28255)

Boyuan Feng committed about 1 year ago

[CLI] add --max-tokens to `vllm complete` (#28109)

Iceber Gu committed about 1 year ago

[CPU]Avoid repeated random sample compile (#28260)

Zhang Xiangze committed about 1 year ago

[Kernel] LoRA triton kernels support PDL (#27402)

Jee Jee Li committed about 1 year ago

Fix issues from #28242 (#28257)

Harry Mellor committed about 1 year ago

Add runai model streamer e2e test for GCS (#28079)

Alexis MacAskill committed about 1 year ago

← Newer Page 567 of 1120 Older →