@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 02:15 UTC

main

[Doc] Update notes (#20668)

Cyrus Leung committed over 1 year ago

[V1] [Doc] Update V1 docs for Mamba models (#20499)

Thomas Parnell committed over 1 year ago

[XPU] Use spawn with XPU multiprocessing (#20649)

Dmitry Rogozhkin committed over 1 year ago

Fix bullets in incremental_build.md (#20642)

Michael Goin committed over 1 year ago

[Hardware][PPC64LE] Enable V1 for ppc64le and ARM (#20554)

Akash kaothalkar committed over 1 year ago

[tech debt] Revisit lora request model checker (#20636)

kourosh hakhamaneshi committed over 1 year ago

[TPU][Bugfix] disable phi-3 test (#20632)

QiliangCui committed over 1 year ago

← Newer Page 742 of 1120 Older →