@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 17:00 UTC

main

[TPU] Async output processing for TPU (#8011)

Woosuk Kwon committed about 2 years ago

[Core] Logprobs support in Multi-step (#7652)

afeldman-nm committed about 2 years ago

Add more percentiles and latencies (#7759)

Wei-Sheng Chin committed about 2 years ago

[Neuron] Adding support for context-lenght, token-gen buckets. (#7885)

Harsha vardhan manoj Bikki committed about 2 years ago

extend cuda graph size for H200 (#7894)

kushanam committed about 2 years ago

[Core] Combine async postprocessor and multi-step (#7921)

Alexander Matveev committed about 2 years ago

[torch.compile] remove reset (#7975)

youkaichao committed about 2 years ago

← Newer Page 995 of 1120 Older →