@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 23:30 UTC

main

[Bugfix] Fix 2 Node and Spec Decode tests (#13341)

Cyrus Leung committed over 1 year ago

[ci] skip failed tests for flashinfer (#13352)

youkaichao committed over 1 year ago

[V1] Update doc and examples for H2O-VL (#13349)

Roger Wang committed over 1 year ago

[Bugfix] Pin xgrammar to 0.1.11 (#13338)

Michael Goin committed over 1 year ago

[V1][Spec Decode] Ngram Spec Decode (#12193)

Lily Liu committed over 1 year ago

[ci/build] update flashinfer (#13323)

youkaichao committed over 1 year ago

[AMD] [Model] DeepSeek tunings (#13199)

rasmith committed over 1 year ago

[Bugfix] Massage MLA's usage of flash attn for RoCM (#13310)

Tyler Michael Smith committed almost 2 years ago

[Bugfix][Docs] Fix offline Whisper (#13274)

Nicolò Lucchesi committed almost 2 years ago

← Newer Page 889 of 1120 Older →