@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[BugFix][DP/EP] Fix CUTLASS MLA hang under load (#26026)

Lucas Wilkinson committed about 1 year ago

[NVIDIA] Blackwell Family (#24673)

Johnny committed about 1 year ago

[Doc] updating torch.compile doc link (#25989)

nadathurv committed about 1 year ago

[Misc]allow disable pynccl (#25421)

Lucia Fang committed about 1 year ago

Update to Transformers `v4.56.2` (#24638)

Harry Mellor committed about 1 year ago

[Bugfix] Fix `__syncwarp` on ROCM (#25996)

Zhewen Li committed about 1 year ago

[MM] Add text-only mode for Qwen3-VL (#26000)

Roger Wang committed about 1 year ago

[Log] Optimize Log for FP8MOE (#25709)

Wentao Ye committed about 1 year ago

← Newer Page 618 of 1120 Older →