A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 09:15 UTC
main
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Fix a bug in swap_in and swap_out
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Add find method to sequence group
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago
BlockAllocator -> BlockManager
Woosuk Kwon committed almost 4 years ago
Woosuk Kwon committed almost 4 years ago