@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 11, 01:15 UTC

main

[Model] Fix bagel failed to run (#31132)

Li Wang committed 11 months ago

[Misc] Fix quantization-related typos (#31116)

Kevin McKay committed 11 months ago

[Misc] Fix spelling typos in comments (#31114)

Kevin McKay committed 11 months ago

[CI] Fix "2 Node Tests (4 GPUs in total)" (#31090)

Lucas Wilkinson committed 11 months ago

[Doc] Clarify FP8 KV cache computation workflow (#31071)

Steve Westerhouse committed 11 months ago

[MoE Refactor][4/N] Marlin Fp8 Mk (#31036)

Robert Shaw committed 11 months ago

[CI] Fix H200 Distributed test (#31054)

Lucas Wilkinson committed 11 months ago

← Newer Page 498 of 1120 Older →