@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 08:00 UTC

main

add QWen-7b (#685)

Qing committed over 3 years ago

Bump up version to 0.1.3 (#657)

Zhuohan Li committed over 3 years ago

[Doc] Add Baichuan 13B to supported models (#656)

Zhuohan Li committed over 3 years ago

Refactor scheduler (#658)

Woosuk Kwon committed over 3 years ago

Add Falcon support (new) (#592)

Zhuohan Li committed over 3 years ago

Fix log message in scheduler (#652)

Lily Liu committed over 3 years ago

fix biachuan-7b tp (#598)

Qing committed over 3 years ago

fix doc (#622)

Chaofan Lin committed over 3 years ago

fix ModuleNotFoundError (#599)

Fang li committed over 3 years ago

[Fix] fix import error of RayWorker (#604) (#605)

Xudong Zhang committed over 3 years ago

Add Baichuan-7B to README (#494)

Zhuohan Li committed over 3 years ago

fixed tensor parallel is not defined (#564)

MoeedDar committed over 3 years ago

Fix paged attention testing. (#495)

Tao Peng committed over 3 years ago

← Newer Page 1107 of 1120 Older →