@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 15:45 UTC

main

[misc] soft drop beam search (#8763)

youkaichao committed about 2 years ago

[CI/Build] fix setuptools-scm usage (#8771)

Daniele committed about 2 years ago

re-implement beam search on top of vllm core (#8726)

youkaichao committed about 2 years ago

[Hardware][AMD] ROCm6.2 upgrade (#8674)

Hongxia Yang committed about 2 years ago

[Core] Allow IPv6 in VLLM_HOST_IP with zmq (#8575)

Russell Bryant committed about 2 years ago

← Newer Page 982 of 1120 Older →