@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 15:45 UTC

main

[Misc] Add argument to disable FastAPI docs (#8554)

Jiaxin Shan committed about 2 years ago

[CI/Build] fix Dockerfile.cpu on podman (#8540)

Daniele committed about 2 years ago

[CI/Build] Excluding kernels/test_gguf.py from ROCm (#8520)

Alexey Kondratiev(AMD) committed about 2 years ago

[doc] improve installation doc (#8550)

youkaichao committed about 2 years ago

[Bugfix] Fix TP > 1 for new granite (#8544)

Joe Runde committed about 2 years ago

[Frontend] Improve Nullable kv Arg Parsing (#8525)

Alex Brooks committed about 2 years ago

[refactor] remove triton based sampler (#8524)

Simon Mo committed about 2 years ago

[Bugfix] Fix 3.12 builds on main (#8510)

Joe Runde committed about 2 years ago

[misc] small qol fixes for release process (#8517)

Simon Mo committed about 2 years ago

[perf bench] set timeout to debug hanging (#8516)

Simon Mo committed about 2 years ago

← Newer Page 986 of 1120 Older →