@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 07:00 UTC

main

[Doc] fix link for page that was renamed (#10455)

Russell Bryant committed almost 2 years ago

Fix: Build error seen on Power Architecture (#10421)

Manjul Mohan committed almost 2 years ago

[misc][plugin] improve plugin loading (#10443)

youkaichao committed almost 2 years ago

[Doc] Add the start of an arch overview page (#10368)

Russell Bryant committed almost 2 years ago

[Misc] Avoid misleading warning messages (#10438)

Jee Jee Li committed almost 2 years ago

[Bugfix]Fix Phi-3 BNB online quantization (#10417)

Jee Jee Li committed almost 2 years ago

[ci][bugfix] fix kernel tests (#10431)

youkaichao committed almost 2 years ago

[Kernel] Initial Machete W4A8 support + Refactors (#9855)

Lucas Wilkinson committed almost 2 years ago

[Model][Bugfix] Support TP for PixtralHF ViT (#10405)

Michael Goin committed almost 2 years ago

← Newer Page 946 of 1120 Older →