@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 05:45 UTC

main

[torch.compile] support encoder based models (#10613)

youkaichao committed almost 2 years ago

Support Cross encoder models (#10400)

Maximilien de Bayser committed almost 2 years ago

[doc] update the code to add models (#10603)

youkaichao committed almost 2 years ago

[Bugfix] Fix LoRA weight sharding (#10450)

Jee Jee Li committed almost 2 years ago

[Platforms] Refactor openvino code (#10573)

JiHuazhong committed almost 2 years ago

Prefix Cache Aware Scheduling [1/n] (#10128)

Ricky Xu committed almost 2 years ago

← Newer Page 942 of 1120 Older →