@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

Migrate tarsier inputs to TensorSchema (#23500)

Benji Beck committed about 1 year ago

[Misc] Unified linear print info (#23516)

Jee Jee Li committed about 1 year ago

[Doc: ]fix various typos in multiple files (#23487)

Didier Durand committed about 1 year ago

[Misc] Remove unused slot_mapping buffer (#23502)

Woosuk Kwon committed about 1 year ago

[Model] Enable BLOOM on V1 (#23488)

Cyrus Leung committed about 1 year ago

[New Model]Donut model (#23229)

汪志鹏 committed about 1 year ago

[kernel] Support W4A8 on Hopper (#23198)

czhu-cohere committed about 1 year ago

Migrate Paligemma inputs to TensorSchema (#23470)

Benji Beck committed about 1 year ago

Migrate Pixtral inputs to TensorSchema (#23472)

Benji Beck committed about 1 year ago

[gpt-oss] Streaming Output for Python Tool (#23409)

Jiangyun Zhu committed about 1 year ago

[Misc] Modify CacheConfig import (#23459)

Jee Jee Li committed about 1 year ago

Support DeepSeek-V3.1 tool call (#23454)

Xu Wenqing committed about 1 year ago

← Newer Page 678 of 1120 Older →