@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 08:15 UTC

main

[CI/Build] Always run mypy (#10122)

Russell Bryant committed about 2 years ago

[Frontend] Tool calling parser for Granite 3.0 models (#9027)

Maximilien de Bayser committed about 2 years ago

[CI/Build] Improve mypy + python version matrix (#10041)

Russell Bryant committed about 2 years ago

Doc: Improve benchmark documentation (#9927)

Rafael Vasquez committed about 2 years ago

[CI/Build] re-add codespell to CI (#10083)

Russell Bryant committed about 2 years ago

[doc] add back Python 3.8 ABI (#10100)

youkaichao committed about 2 years ago

[Hardware][CPU] Update torch 2.5 (#9911)

Li, Jiang committed about 2 years ago

← Newer Page 955 of 1120 Older →