@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 04:45 UTC

main

[Fix] import regex instead of re (#19875)

Thomas Parnell committed over 1 year ago

[Misc] update cuda version (#19526)

Reid committed over 1 year ago

[Bugfix] Enable PP with AITER+V1 (#19822)

qli88 committed over 1 year ago

[CI][Neuron] Fail and exit on first error (#19622)

Elaine Zhao committed over 1 year ago

[Core][Bugfix] Fix Online MM Beam Search (#19688)

Alex Brooks committed over 1 year ago

Fixing Chunked Prefill Test. (#19762)

Alexei-V-Ivanov-AMD committed over 1 year ago

Add xLAM tool parser support (#17148)

Zuxin committed over 1 year ago

← Newer Page 759 of 1120 Older →