@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[Models] Improve iteration over layers (#19497)

Lukas Geiger committed about 1 year ago

[V0 Deprecation] Remove V0 Samplers test (#23862)

Woosuk Kwon committed about 1 year ago

[V1] Enable prefill optimization for Gemma3n (#22628)

Yong Hoon Shin committed about 1 year ago

chore: build release image by default (#23852)

Simon Mo committed about 1 year ago

[ROCm][Aiter] Add triton fp8 bmm kernel for mla (#23264)

Divakar Verma committed about 1 year ago

[Bugfix] Add fake mode around passes (#23349)

Angela Yi committed about 1 year ago

[CI] Fix linting error on main (#23835)

Thomas Parnell committed about 1 year ago

[Doc]: fix typos in Python scripts (#23828)

Didier Durand committed about 1 year ago

[Model] [gpt-oss] fix gpt-oss pp support (#23815)

Jiangyun Zhu committed about 1 year ago

← Newer Page 670 of 1120 Older →