@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 01:45 UTC

main

[BUG] fixed fp8 conflict with aqlm (#4307)

Robert Shaw committed over 2 years ago

[Kernel] FP8 support for MoE kernel / Mixtral (#4244)

Philipp Moritz committed over 2 years ago

AQLM CUDA support (#3287)

James Fleming committed over 2 years ago

[CI] Add ccache for wheel builds job (#4281)

Simon Mo committed over 2 years ago

[Core] Scheduling optimization 2 (#4280)

SangBin Cho committed over 2 years ago

Fix `autodoc` directives (#4272)

Harry Mellor committed over 2 years ago

[Core] Scheduler perf fix (#4270)

SangBin Cho committed over 2 years ago

Add example scripts to documentation (#4225)

Harry Mellor committed over 2 years ago

← Newer Page 1062 of 1120 Older →