@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 18:15 UTC

main

llama_index serving integration documentation (#6973)

Kameshwara Pavan Kumar Mantha committed over 2 years ago

[Misc] Revert `compressed-tensors` code reuse (#7521)

Kyle Sayers committed over 2 years ago

[TPU] Set per-rank XLA cache (#7533)

Woosuk Kwon committed over 2 years ago

[core] [3/N] multi-step args and sequence.py (#7452)

William Lin committed over 2 years ago

[ci] fix model tests (#7507)

youkaichao committed over 2 years ago

Fix empty output when temp is too low (#2937)

Chang Su committed over 2 years ago

[Bugfix][Docs] Update list of mock imports (#7493)

Cyrus Leung committed over 2 years ago

[misc][ci] fix cpu test with plugins (#7489)

youkaichao committed over 2 years ago

← Newer Page 1004 of 1120 Older →