@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 20:45 UTC

main

[Core] Fix ray forward_dag error mssg (#6792)

SangBin Cho committed over 2 years ago

[Docs] Publish 5th meetup slides (#6799)

Woosuk Kwon committed over 2 years ago

[Bugfix] Add synchronize to prevent possible data race (#6788)

Tyler Michael Smith committed over 2 years ago

[Bugfix] Fix awq_marlin and gptq_marlin flags (#6745)

Alexander Matveev committed over 2 years ago

[Model] Adding support for MiniCPM-V (#4087)

Alphi committed over 2 years ago

[core][distributed] fix zmq hang (#6759)

youkaichao committed over 2 years ago

[Bugfix] Bump transformers to 4.43.2 (#6752)

Michael Goin committed over 2 years ago

Add fp8 support to `reshape_and_cache_flash` (#6667)

Antoni Baum committed over 2 years ago

← Newer Page 1017 of 1120 Older →