@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 04:15 UTC

main

[Bugfix][Model] Fix Qwen2 (#3554)

Roy committed over 2 years ago

[1/n] Triton sampling kernel (#3186)

Antoni Baum committed over 2 years ago

[Bugfix] Fix ROCm support in CMakeLists.txt (#3534)

James Whedbee committed over 2 years ago

[Misc] Remove cache stream and cache events (#3461)

Woosuk Kwon committed over 2 years ago

[Core] Add generic typing to `LRUCache` (#3511)

Nick Hill committed over 2 years ago

Revert "[Core] Cache some utils" (#3507)

Simon Mo committed over 2 years ago

← Newer Page 1074 of 1120 Older →