@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 09:30 UTC

main

[CI/Build] mergify: fix rules for ci/build label (#9804)

Russell Bryant committed about 2 years ago

[Bugfix] Use host argument to bind to interface (#9798)

Sven Seeberg committed about 2 years ago

[Bugfix] Use temporary directory in registry (#9721)

Cyrus Leung committed about 2 years ago

[Doc] Specify async engine args in docs (#9726)

Cyrus Leung committed about 2 years ago

[Model][LoRA]LoRA support added for Qwen (#9622)

Jee Jee Li committed about 2 years ago

[Doc] fix third-party model example (#9771)

Russell Bryant committed about 2 years ago

[torch.compile] add deepseek v2 compile (#9775)

youkaichao committed about 2 years ago

[misc] avoid circular import (#9765)

youkaichao committed about 2 years ago

← Newer Page 962 of 1120 Older →