@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 01:45 UTC

main

[Doc] Chunked Prefill Documentation (#4580)

SangBin Cho committed over 2 years ago

[Misc] add installation time env vars (#4574)

youkaichao committed over 2 years ago

[Kernel] Use flashinfer for decoding (#4353)

Lily Liu committed over 2 years ago

Fix/async chat serving (#2727)

Sebastian Schoennenbeck committed over 2 years ago

[Doc] add env vars to the doc (#4572)

youkaichao committed over 2 years ago

[Misc] remove chunk detected debug logs (#4571)

DefTruth committed over 2 years ago

[Core] Ignore infeasible swap requests. (#4557)

SangBin Cho committed over 2 years ago

[CI/Build] AMD CI pipeline with extended set of tests. (#4267)

Alexei-V-Ivanov-AMD committed over 2 years ago

[mypy][7/N] Cover all directories (#4555)

SangBin Cho committed over 2 years ago

← Newer Page 1057 of 1120 Older →