@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[Misc] Remove cruft file in repo (#25678)

Nicolò Lucchesi committed about 1 year ago

[torch.compile] Make Query Quantization Fusable (#24914)

Jonas M. Kübler committed about 1 year ago

[CI/Build] Fix flaky entrypoints test (#25663)

Cyrus Leung committed about 1 year ago

[mypy] Further improve MM type annotations (#25654)

Cyrus Leung committed about 1 year ago

[Bugfix] Add triton.language.tensor placeholder (#25649)

Agata Dobrzyniewicz committed about 1 year ago

← Newer Page 626 of 1120 Older →