@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 03:00 UTC

main

[Misc] Minor type annotation fix (#3716)

Woosuk Kwon committed over 2 years ago

Revert "bump version to v0.4.0" (#3708)

youkaichao committed over 2 years ago

bump version to v0.4.0 (#3705)

Simon Mo committed over 2 years ago

[Core] fix del of communicator (#3702)

youkaichao committed over 2 years ago

fix logging msg for block manager (#3701)

Simon Mo committed over 2 years ago

[2/N] Chunked prefill data update (#3538)

SangBin Cho committed over 2 years ago

[Kernel] DBRX Triton MoE kernel H100 (#3692)

Roger Wang committed over 2 years ago

[Model] Add support for Qwen2MoeModel (#3346)

wenyujin333 committed over 2 years ago

[Model] Add support for xverse (#3610)

hxer7963 committed over 2 years ago

← Newer Page 1071 of 1120 Older →