@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 22:00 UTC

main

Benchmark: add H100 suite (#6047)

Simon Mo committed over 2 years ago

[ Misc ] Refactor Marlin Python Utilities (#6082)

Robert Shaw committed over 2 years ago

[BugFix]: set outlines pkg version (#6262)

Lim Xiang Yang committed over 2 years ago

[Doc] Update description of vLLM support for CPUs (#6003)

Jie Fu (傅杰) committed over 2 years ago

[CI/Build] Enable mypy typing for remaining folders (#6268)

Benjamin Muskalla committed over 2 years ago

[Bugfix] Support 2D input shape in MoE layer (#6287)

Woosuk Kwon committed over 2 years ago

[Doc] Guide for adding multi-modal plugins (#6205)

Cyrus Leung committed over 2 years ago

← Newer Page 1027 of 1120 Older →