@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[Multimodal] Always enable hashing mm data (#23308)

Roger Wang committed about 1 year ago

[Doc] Fix batch-level DP example (#23325)

Cyrus Leung committed about 1 year ago

[Refactor] Simplify code for MM budget (#23310)

Cyrus Leung committed about 1 year ago

[Model] Add LFM2 architecture (#22845)

Paul Pak committed about 1 year ago

[BugFix] Fix Python 3.9 Support (#23306)

Jared O'Connell committed about 1 year ago

[CI] Block the cu126 wheel build while broken (#23285)

Michael Goin committed about 1 year ago

[CI] Delete images older than 24h. (#23291)

QiliangCui committed about 1 year ago

[Model][VLM] Support R-4B Model (#23246)

杨奇(yann qi) committed about 1 year ago

[CI/Build] Split out mm processor tests (#23260)

Cyrus Leung committed about 1 year ago

[CPU] Refactor CPU W8A8 scaled_mm (#23071)

Li, Jiang committed about 1 year ago

Remove duplicate entry in vllm.attention.__all__ (#23296)

Russell Bryant committed about 1 year ago

← Newer Page 682 of 1120 Older →