@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 19:30 UTC

main

[ROCm] Upgrade PyTorch nightly version (#6845)

Woosuk Kwon committed over 2 years ago

[Bugfix]: Fix Tensorizer test failures (#6835)

Sanger Steel committed over 2 years ago

[Bug Fix] Illegal memory access, FP8 Llama 3.1 405b (#6852)

Lucas Wilkinson committed over 2 years ago

Update README.md (#6847)

Gurpreet Singh Dhami committed over 2 years ago

[Doc] Add Nemotron to supported model docs (#6843)

Michael Goin committed over 2 years ago

[Bugfix][Kernel] Promote another index to int64_t (#6838)

Tyler Michael Smith committed over 2 years ago

[doc][debugging] add known issues for hangs (#6816)

youkaichao committed over 2 years ago

[Core] Use array to speedup padding (#6779)

Peng Guanwen committed over 2 years ago

Fix ReplicatedLinear weight loading (#6793)

QQSong committed over 2 years ago

[ci][distributed] fix flaky tests (#6806)

youkaichao committed over 2 years ago

← Newer Page 1016 of 1120 Older →