@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 19:30 UTC

main

[Model]Refactor MiniCPMV (#7020)

Jee Jee Li committed over 2 years ago

[misc] add zmq in collect env (#7119)

youkaichao committed over 2 years ago

[LoRA] ReplicatedLinear support LoRA (#7081)

Jee Jee Li committed over 2 years ago

[ci][distributed] disable ray dag tests (#7099)

youkaichao committed over 2 years ago

[Frontend] Factor out chat message parsing (#7055)

Cyrus Leung committed over 2 years ago

[misc] add a flag to enable compile (#7092)

youkaichao committed over 2 years ago

[Core] Pipeline parallel with Ray ADAG (#6837)

Rui Qiao committed over 2 years ago

[CI/Build] Add support for Python 3.12 (#7035)

Michael Goin committed over 2 years ago

← Newer Page 1011 of 1120 Older →