@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 06:45 UTC

main

Build CUDA11.8 wheels for release (#1596)

Woosuk Kwon committed about 3 years ago

Upgrade to CUDA 12 (#1527)

Zhuohan Li committed about 3 years ago

ChatGLM Support (#1261)

GoHomeToMacDonal committed about 3 years ago

Support Yi model (#1567)

Roy committed about 3 years ago

Add Quantization and AutoAWQ to docs (#1235)

Casper committed about 3 years ago

Support YaRN models (#1264)

Antoni Baum committed about 3 years ago

docs: add description (#1553)

lots-o committed about 3 years ago

Force paged attention v2 for long contexts (#1510)

Antoni Baum committed about 3 years ago

Remove `MPTConfig` (#1529)

Woosuk Kwon committed about 3 years ago

Add `/health` Endpoint for both Servers (#1540)

Fluder-Paradyne committed about 3 years ago

Add `MptForCausalLM` key in model_loader (#1526)

Wenfei Yan committed about 3 years ago

Fix integer overflows in attention & cache ops (#1514)

Woosuk Kwon committed about 3 years ago

Add Dockerfile (#1350)

Stephen Krider committed about 3 years ago

[Fix] Fix duplicated logging messages (#1524)

Zhuohan Li committed about 3 years ago

Add support for `spaces_between_special_tokens`

Dan Lord committed about 3 years ago

← Newer Page 1098 of 1120 Older →