@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 23:15 UTC

main

[Model] Add Gemma 2 (#5908)

Woosuk Kwon committed over 2 years ago

[doc][misc] add note for Kubernetes users (#5916)

youkaichao committed over 2 years ago

[CI/Build] [1/3] Reorganize entrypoints tests (#5526)

Cyrus Leung committed over 2 years ago

[BugFix] Fix cuda graph for MLPSpeculator (#5875)

Nick Hill committed over 2 years ago

[Misc] Add example for LLaVA-NeXT (#5879)

Roger Wang committed over 2 years ago

Support CPU inference with VSX PowerPC ISA (#5652)

Chip Kerchner committed over 2 years ago

[Bugfix][TPU] Fix CPU cache allocation (#5869)

Woosuk Kwon committed over 2 years ago

[CI/Build] Refactor image test assets (#5821)

Cyrus Leung committed over 2 years ago

← Newer Page 1034 of 1120 Older →