@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 18:30 UTC

main

[Doc] Add vLLM Beijing meetup slide (#14938)

Chen Zhang committed over 1 year ago

[V1] Remove input cache client (#14864)

Cyrus Leung committed over 1 year ago

[V1][Minor] Add __repr__ to ConstantList (#14907)

Woosuk Kwon committed over 1 year ago

[V1] Optimize the overhead of rewinding (#14905)

Woosuk Kwon committed over 1 year ago

[CI] Nightly Tests (#14898)

Robert Shaw committed over 1 year ago

[V1] Enable Entrypoints Tests (#14903)

Robert Shaw committed over 1 year ago

[V1] [Spec Decode] Fix ngram tests (#14878)

Lily Liu committed over 1 year ago

← Newer Page 860 of 1120 Older →