@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 07:00 UTC

main

[misc] improve error message (#10553)

youkaichao committed almost 2 years ago

[8/N] enable cli flag without a space (#10529)

youkaichao committed almost 2 years ago

[Kernel] Register punica ops directly (#10522)

Jee Jee Li committed almost 2 years ago

[Misc] Increase default video fetch timeout (#10495)

Cyrus Leung committed almost 2 years ago

[torch.compile] Inductor code caching fix (#10273)

Luka Govedič committed almost 2 years ago

[Platforms] Add `device_type` in `Platform` (#10508)

Mengqing Cao committed almost 2 years ago

[Core] Add Sliding Window Support with Flashinfer (#10462)

Pavani Majety committed almost 2 years ago

[TPU] Implement prefix caching for TPUs (#10307)

Woosuk Kwon committed almost 2 years ago

← Newer Page 944 of 1120 Older →