@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 09:30 UTC

main

[CI/Build] Adopt Mergify for auto-labeling PRs (#9259)

Russell Bryant committed about 2 years ago

[Bugfix] Fix ray instance detect issue (#9439)

Yan Ma committed about 2 years ago

Fix beam search eos (#9627)

Robert Shaw committed about 2 years ago

[torch.compile] support moe models (#9632)

youkaichao committed about 2 years ago

[Bugfix] Fix load config when using bools (#9533)

madt2709 committed about 2 years ago

[Misc] Upgrade to pytorch 2.5 (#9588)

bnellnm committed about 2 years ago

[Frontend] Bad words sampling parameter (#9717)

Vasiliy Alekseev committed about 2 years ago

[Doc] Improve quickstart documentation (#9256)

Rafael Vasquez committed about 2 years ago

[V1] Support sliding window attention (#9679)

Woosuk Kwon committed about 2 years ago

← Newer Page 963 of 1120 Older →