@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 00:30 UTC

main

[Lora] Support long context lora (#4787)

SangBin Cho committed over 2 years ago

[Bugfix] Relax tiktoken to >= 0.6.0 (#4890)

Michael Goin committed over 2 years ago

[Bugfix] Fix FP8 KV cache support (#4869)

Woosuk Kwon committed over 2 years ago

[Kernel] Add w8a8 CUTLASS kernels (#4749)

Tyler Michael Smith committed over 2 years ago

[Misc] remove old comments (#4866)

youkaichao committed over 2 years ago

Add GPTQ Marlin 2:4 sparse structured support (#4790)

Alexander Matveev committed over 2 years ago

← Newer Page 1052 of 1120 Older →