@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 20:45 UTC

main

[misc][distributed] improve tests (#6488)

youkaichao committed over 2 years ago

[Misc] Log spec decode metrics (#6454)

Cody Yu committed over 2 years ago

[CI/Build] Remove "boardwalk" image asset (#6460)

Cyrus Leung committed over 2 years ago

[Misc] Fix typos in spec. decode metrics logging. (#6470)

Thomas Parnell committed over 2 years ago

[CI/Build] vLLM cache directory for images (#6444)

Cyrus Leung committed over 2 years ago

[Docs] Announce 5th meetup (#6458)

Woosuk Kwon committed over 2 years ago

Pin sphinx-argparse version (#6453)

Kevin H. Luu committed over 2 years ago

[CI/Build][TPU] Add TPU CI test (#6277)

Woosuk Kwon committed over 2 years ago

[Docs] Add Google Cloud to sponsor list (#6450)

Woosuk Kwon committed over 2 years ago

← Newer Page 1023 of 1120 Older →