@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 01:45 UTC

main

[Core][Distributed] refactor pynccl (#4591)

youkaichao committed over 2 years ago

[Bugfix] Add logs for all model dtype casting (#4717)

Michael Goin committed over 2 years ago

[Bugfix] Update grafana.json (#4711)

Robert Shaw committed over 2 years ago

[Misc] Remove unnecessary ModelRunner imports (#4703)

Woosuk Kwon committed over 2 years ago

[CI/Test] fix swap test for multi gpu (#4689)

youkaichao committed over 2 years ago

[Core] Faster startup for LoRA enabled models (#4634)

Antoni Baum committed over 2 years ago

← Newer Page 1055 of 1120 Older →