@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 12:15 UTC

main

[Fix] Support passing args to logger (#17425)

Aaron Pham committed over 1 year ago

[Core] Prevent side-channel attacks via cache salting (#17045)

Marko Rosenmueller committed over 1 year ago

[Misc] Remove deprecated files (#17447)

Chauncey committed over 1 year ago

[Hardware][Intel GPU] Upgrade to torch 2.7 (#17444)

Kunshang Ji committed over 1 year ago

Support LoRA for Mistral3 (#17428)

Michael Goin committed over 1 year ago

Fix call to `logger.info_once` (#17416)

Harry Mellor committed over 1 year ago

Improve configs - `ModelConfig` (#17130)

Harry Mellor committed over 1 year ago

Update PyTorch to 2.7.0 (#16859)

Huy Do committed over 1 year ago

← Newer Page 811 of 1120 Older →