@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[misc] fix typo in value error (#24995)

Prashant Gupta committed about 1 year ago

[Docs] fix invalid doc link (#25017)

yyzxw committed about 1 year ago

Removes source compilation of nixl dependency (#24874)

Benjamin Bartels committed about 1 year ago

[CI] GPT-OSS GPQA eval test for Blackwell (#24920)

Michael Goin committed about 1 year ago

[CI][Bugfix] Fix failing Blackwell test (#24993)

Matthew Bonanni committed about 1 year ago

[Perf] Reuse workspace for FP8+FP4 Marlin MoE (#20500)

Michael Goin committed about 1 year ago

fp8 kv cache support fix for torch.compile (#22758)

Aleksandr Malyshev committed about 1 year ago

[ROCm] Add dependencies for ROCm (#24900)

Concurrensee committed about 1 year ago

← Newer Page 644 of 1120 Older →