@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

correct LWS deployment yaml (#23104)

Christian Berge committed about 1 year ago

[Model] Support dp on ViT on GLM-4.5V (#23168)

WeiQing Chen committed about 1 year ago

[Doc]: fix typos in Python comments (#24077)

Didier Durand committed about 1 year ago

Migrate Interns1 inputs to TensorSchema (#23510)

Benji Beck committed about 1 year ago

Remove runtime checks based on pooling params (#24051)

Maximilien de Bayser committed about 1 year ago

[V1][Mamba1] - FP32 SSM Kernel Support (#23506)

Asaf Joseph Gardin committed about 1 year ago

[Doc]: fix typos in Python comments (#24042)

Didier Durand committed about 1 year ago

[bugfix]fix MTP hidden states (#24056)

Lucia Fang committed about 1 year ago

[docs][misc] IOProcessor plugins fixes (#24046)

Christian Pinto committed about 1 year ago

[Model]: support KeyeVL-1_5-8B (#23838)

Kwai-Keye committed about 1 year ago

← Newer Page 666 of 1120 Older →