@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 20:45 UTC

main

[Docs] Update docs for wheel location (#6580)

Simon Mo committed over 2 years ago

[Misc] Small perf improvements (#6520)

Antoni Baum committed over 2 years ago

Add support for a rope extension method (#6553)

Simon Mo committed over 2 years ago

[CI/Build] Build on Ubuntu 20.04 instead of 22.04 (#6517)

Tyler Michael Smith committed over 2 years ago

Fix PR comment bot (#6554)

Kevin H. Luu committed over 2 years ago

[Model] Support Mistral-Nemo (#6548)

Michael Goin committed over 2 years ago

[ci] Reword Github bot comment (#6534)

Kevin H. Luu committed over 2 years ago

[TPU] Refactor TPU worker & model runner (#6506)

Woosuk Kwon committed over 2 years ago

← Newer Page 1021 of 1120 Older →