@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 01:00 UTC

main

Add full serve CLI reference back to docs (#20978)

Harry Mellor committed over 1 year ago

[Deprecation] Remove `nullable_kvs` (#20969)

Harry Mellor committed over 1 year ago

Configure Gemini (#20971)

Harry Mellor committed over 1 year ago

Voxtral (#20970)

Patrick von Platen committed over 1 year ago

[v1][core] Support for attention free models (#20811)

Christian Pinto committed over 1 year ago

[Deprecation] Remove `TokenizerPoolConfig` (#20968)

Harry Mellor committed over 1 year ago

[TPU] Optimize kv cache update kernel (#20415)

Yifei Teng committed over 1 year ago

[Docs] Improve documentation for RLHF example (#20598)

Ricardo Decal committed over 1 year ago

Implement Async Scheduling (#19970)

Woosuk Kwon committed over 1 year ago

← Newer Page 734 of 1120 Older →