@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 20:45 UTC

main

[doc][distributed] fix doc argument order (#6691)

youkaichao committed over 2 years ago

[Docs] Announce llama3.1 support (#6688)

Woosuk Kwon committed over 2 years ago

Bump version to v0.5.3 (#6674)

Simon Mo committed over 2 years ago

support ignore patterns in model loader (#6673)

Simon Mo committed over 2 years ago

[misc] only tqdm for first rank (#6672)

youkaichao committed over 2 years ago

[Misc] Manage HTTP connections in one place (#6600)

Cyrus Leung committed over 2 years ago

add tqdm when loading checkpoint shards (#6569)

zhaotyer committed over 2 years ago

[ci][build] add back vim in docker (#6661)

youkaichao committed over 2 years ago

[Frontend] Refactor prompt processing (#4028)

Cyrus Leung committed over 2 years ago

← Newer Page 1019 of 1120 Older →