@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 05:45 UTC

main

[torch.compile] fix shape specialization (#10722)

youkaichao committed almost 2 years ago

[ci] fix slow tests (#10698)

youkaichao committed almost 2 years ago

[Model] Support telechat2 (#10311)

shunxing12345 committed almost 2 years ago

[Misc]Further reduce BNB static variable (#10597)

Jee Jee Li committed almost 2 years ago

[V1] Update interface for idefics3 (#10680)

Roger Wang committed almost 2 years ago

[Bugfix] Fix using `-O[0,3]` with LLM entrypoint (#10677)

Michael Goin committed almost 2 years ago

[Bugfix] Fix for Spec model TP + Chunked Prefill (#10232)

Murali Andoorveedu committed almost 2 years ago

[V1] Enable profile for LLMEngine (#10665)

Kunshang Ji committed almost 2 years ago

← Newer Page 940 of 1120 Older →