@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 5, 01:00 UTC

main

[Misc] Update `committers.md` (#40058)

Matthew Bonanni committed 7 months ago

Gate SSU dispatch setup (#40039)

roikoren755 committed 7 months ago

[CI] Add weight transfer tests to CI (#39821)

Sumanth R Hegde committed 7 months ago

[Misc] Add @sfeng33 to CODEOWNERS (#40048)

Flora Feng committed 7 months ago

[Bugfix] Fix audioflamingo test (#40052)

Roger Wang committed 7 months ago

[Misc] `toy_proxy_server` handle min_tokens (#39706)

Nicolò Lucchesi committed 7 months ago

[Doc] add docs for online quant frontend (#39736)

Vasiliy Kuznetsov committed 7 months ago

[Nixl] Bump Nixl version to 0.10.1 (#39922)

Nicolò Lucchesi committed 7 months ago

← Newer Page 328 of 1120 Older →