@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 6, 17:00 UTC

main

[Model Runner V2] Add Support for XD-RoPE (#36817)

Santino Ramos committed 8 months ago

Mistral common v10 (#36971)

Julien Denize committed 8 months ago

[CI] Pin helion version (#37012)

Yanan Cao committed 8 months ago

[UX] Improve UX of CPU backend (#36968)

Li, Jiang committed 8 months ago

[Refactor] Consolidate SupportsEagle (#36063)

Benjamin Chislett committed 8 months ago

← Newer Page 379 of 1120 Older →