@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 03:00 UTC

main

Fix missing docs and out of sync `EngineArgs` (#4219)

Harry Mellor committed over 2 years ago

[Bugfix] Add fix for JSON whitespace (#4189)

Ayush Rautwar committed over 2 years ago

[Misc] add nccl in collect env (#4211)

youkaichao committed over 2 years ago

[Misc] fix docstrings (#4191)

Uranus committed over 2 years ago

Bump version of 0.4.1 (#4177)

Simon Mo committed over 2 years ago

[Bugfix] Fix LoRA loading check (#4138)

Jee Li committed over 2 years ago

← Newer Page 1063 of 1120 Older →