@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 709a69176e
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 09:15 UTC

Move worker/models -> models

Woosuk Kwon committed Feb 22, 2023 at 18:03 UTC 709a69176ea86f60786acb87ede52e62d9efb036
3 files changed
cacheflow/models/__init__.py renamed
cacheflow/models/model_utils.py renamed
cacheflow/models/opt.py renamed