@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[Metrics] Hide deprecated metrics with gpu_ prefix (#24245)

Mark McLoughlin committed about 1 year ago

Add pytest-cov and .coveragerc (#24778)

Reza Barazesh committed about 1 year ago

[ROCm][Bugfix] Fix the case where there's bias (#24895)

Gregory Shtrasberg committed about 1 year ago

[Tests] fix initialization of kv hash in tests (#24273)

Mickaël Seznec committed about 1 year ago

[ci] fix wheel names for arm wheels (#24898)

Simon Mo committed about 1 year ago

Bump Flashinfer to 0.3.1 (#24868)

Benjamin Bartels committed about 1 year ago

← Newer Page 646 of 1120 Older →