@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 7b89386553
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 23:30 UTC

[V1][BugFix] Add __init__.py to v1/spec_decode/ (#13359)

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Woosuk Kwon committed Feb 16, 2025 at 09:39 UTC 7b89386553e4d382620c0f5025035a4a0af8bbbb
1 file changed
vllm/v1/spec_decode/__init__.py