@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 20:45 UTC

main

bump version to v0.5.2 (#6433)

Simon Mo committed over 2 years ago

[Misc] Use 0.0.9 version for flashinfer (#6447)

Pernekhan Utemuratov committed over 2 years ago

[Kernel] Use CUTLASS kernels for the FP8 layers with Bias (#6270)

Tyler Michael Smith committed over 2 years ago

[doc][misc] doc update (#6439)

youkaichao committed over 2 years ago

[Bugfix] Convert image to RGB by default (#6430)

Cyrus Leung committed over 2 years ago

Add FUNDING.yml (#6435)

Simon Mo committed over 2 years ago

Report usage for beam search (#6404)

Simon Mo committed over 2 years ago

[CI/Build] Cross python wheel (#6394)

Robert Shaw committed over 2 years ago

[Doc] xpu backend requires running setvars.sh (#6393)

Robert Cohn committed over 2 years ago

[Feature] vLLM CLI (#5090)

Ethan Xu committed over 2 years ago

← Newer Page 1024 of 1120 Older →