@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 18:15 UTC

main

[Bugfix] Fix custom_ar support check (#7617)

bnellnm committed over 2 years ago

[Kernel] W8A16 Int8 inside FusedMoE (#7415)

Mor Zusman committed over 2 years ago

support tqdm in notebooks (#7510)

fzyzcjy committed over 2 years ago

[CI] Fix crashes of performance benchmark (#7500)

Kuntai Du committed over 2 years ago

Chat method for offline llm (#5049)

nunjunj committed over 2 years ago

← Newer Page 1003 of 1120 Older →