@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 22:00 UTC

main

Build some nightly wheels by default (#6380)

Simon Mo committed over 2 years ago

[ci] Add GHA workflows to enable full CI run (#6381)

Kevin H. Luu committed over 2 years ago

[Build/CI] Checking/Waiting for the GPU's clean state (#6379)

Alexei-V-Ivanov-AMD committed over 2 years ago

[Bugfix] Fix dtype mismatch in PaliGemma (#6367)

Cyrus Leung committed over 2 years ago

[ Misc ] Remove separate bias add (#6353)

Robert Shaw committed over 2 years ago

[ BugFix ] Prompt Logprobs Detokenization (#6223)

Robert Shaw committed over 2 years ago

[doc] update pipeline parallel in readme (#6347)

youkaichao committed over 2 years ago

← Newer Page 1026 of 1120 Older →