@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 23:15 UTC

main

[Doc] Add "Suggest edit" button to doc pages (#5789)

Michael Goin committed over 2 years ago

[Distributed] Add send and recv helpers (#5719)

Murali Andoorveedu committed over 2 years ago

[BugFix] [Kernel] Add Cutlass2x fallback kernels (#5744)

Varun Sundar Rabindranath committed over 2 years ago

[Docs][TPU] Add installation tip for TPU (#5761)

Woosuk Kwon committed over 2 years ago

[Bugfix] Fix pin_lora error in TPU executor (#5760)

Woosuk Kwon committed over 2 years ago

[ci][test] fix ca test in main (#5746)

youkaichao committed over 2 years ago

[Kernel][CPU] Add Quick `gelu` to CPU (#5717)

Roger Wang committed over 2 years ago

[Core][Distributed] add shm broadcast (#5399)

youkaichao committed over 2 years ago

[BugFix] Fix test_phi3v.py (#5725)

Chang Su committed over 2 years ago

[Kernel] Add punica dimension for Qwen2 LoRA (#5441)

Jinzhen Lin committed over 2 years ago

← Newer Page 1036 of 1120 Older →