@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 00:30 UTC

main

[Docs] Add Sequoia as sponsors (#5287)

Simon Mo committed over 2 years ago

[CI] Add nightly benchmarks (#5260)

Simon Mo committed over 2 years ago

[Misc] Fix docstring of get_attn_backend (#5271)

Woosuk Kwon committed over 2 years ago

[Misc] update collect env (#5261)

youkaichao committed over 2 years ago

[CI/Build] Reducing CPU CI execution time (#5241)

Li, Jiang committed over 2 years ago

[CI/Build] Add inputs tests (#5215)

Cyrus Leung committed over 2 years ago

← Newer Page 1046 of 1120 Older →