@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 23:15 UTC

main

Add ccache to amd (#5555)

Simon Mo committed over 2 years ago

[Bugfix] Fix typo in Pallas backend (#5558)

Woosuk Kwon committed over 2 years ago

[Doc] Update documentation on Tensorizer (#5471)

Sanger Steel committed over 2 years ago

[Docs] Add ZhenFund as a Sponsor (#5548)

Simon Mo committed over 2 years ago

[Kernel] Suppress mma.sp warning on CUDA 12.5 and later (#5401)

Tyler Michael Smith committed over 2 years ago

[ Misc ] Rs/compressed tensors cleanup (#5432)

Robert Shaw committed over 2 years ago

[Misc] Fix arg names (#5524)

Allen.Dou committed over 2 years ago

[Kernel] Fix CUTLASS 3.x custom broadcast load epilogue (#5516)

Tyler Michael Smith committed over 2 years ago

[CI/Build] Disable LLaVA-NeXT CPU test (#5529)

Cyrus Leung committed over 2 years ago

← Newer Page 1040 of 1120 Older →