@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 07:00 UTC

main

[Bugfix] Fix QwenModel argument (#10262)

Jie Fu (傅杰) committed about 2 years ago

[Misc]Fix Idefics3Model argument (#10255)

Jee Jee Li committed about 2 years ago

[doc] explain the class hierarchy in vLLM (#10240)

youkaichao committed about 2 years ago

Splitting attention kernel file (#10091)

Aleksandr Malyshev committed about 2 years ago

[1/N] torch.compile user interface design (#10237)

youkaichao committed about 2 years ago

[doc] update debugging guide (#10236)

youkaichao committed about 2 years ago

[V1] `AsyncLLM` Implementation (#9826)

Robert Shaw committed about 2 years ago

Make shutil rename in python_only_dev (#10233)

Nikolai Shcheglov committed about 2 years ago

Add docs on serving with Llama Stack (#10183)

Yuan Tang committed about 2 years ago

[V1] Use custom ops for piecewise CUDA graphs (#10227)

Woosuk Kwon committed about 2 years ago

[V1] Fix detokenizer ports (#10224)

Woosuk Kwon committed about 2 years ago

← Newer Page 951 of 1120 Older →