@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 00:45 UTC

main

Set weights_only=True when using torch.load() (#12366)

Russell Bryant committed almost 2 years ago

[Docs] Add meetup slides (#12345)

Woosuk Kwon committed almost 2 years ago

[Docs] Document Phi-4 support (#12362)

Isotr0py committed almost 2 years ago

[core] add wake_up doc and some sanity check (#12361)

youkaichao committed almost 2 years ago

[V1] Simplify M-RoPE (#12352)

Roger Wang committed almost 2 years ago

[Kernel] Flash Attention 3 Support (#12093)

Lucas Wilkinson committed almost 2 years ago

[V1] Add `uncache_blocks` (#12333)

Cody Yu committed almost 2 years ago

[Docs] Document vulnerability disclosure process (#12326)

Russell Bryant committed almost 2 years ago

← Newer Page 906 of 1120 Older →