@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 19:30 UTC

main

[Kernel] Remove scaled_fp8_quant kernel padding footgun (#6842)

Tyler Michael Smith committed over 2 years ago

[Kernel] Squash a few more warnings (#6914)

Tyler Michael Smith committed over 2 years ago

[Doc] Super tiny fix doc typo (#6949)

fzyzcjy committed over 2 years ago

[Bugfix] Fix PaliGemma MMP (#6930)

Roger Wang committed over 2 years ago

[TPU] Fix greedy decoding (#6933)

Woosuk Kwon committed over 2 years ago

[Kernel] Tuned int8 kernels for Ada Lovelace (#6848)

Varun Sundar Rabindranath committed over 2 years ago

[Kernel] Fix marlin divide-by-zero warnings (#6904)

Tyler Michael Smith committed over 2 years ago

[Kernel] Remove unused variables in awq/gemm_kernels.cu (#6908)

Tyler Michael Smith committed over 2 years ago

← Newer Page 1014 of 1120 Older →