@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 18:15 UTC

main

[OpenVINO] Updated documentation (#7687)

Ilya Lavrenov committed about 2 years ago

[misc][cuda] add warning for pynvml user (#7675)

youkaichao committed about 2 years ago

[CI] Organizing performance benchmark files (#7616)

Kuntai Du committed about 2 years ago

[ci] Install Buildkite test suite analysis (#7667)

Kevin H. Luu committed about 2 years ago

[doc] fix doc build error caused by msgspec (#7659)

youkaichao committed about 2 years ago

[TPU] Remove redundant input tensor cloning (#7660)

Woosuk Kwon committed about 2 years ago

[Bugfix] Don't disable existing loggers (#7664)

Andrew Song committed about 2 years ago

[core] Multi Step Scheduling (#7000)

William Lin committed about 2 years ago

[Misc] Remove Gemma RoPE (#7638)

Woosuk Kwon committed about 2 years ago

← Newer Page 1001 of 1120 Older →