@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 03:00 UTC

main

[Misc] Fix typo in scheduler.py (#4022)

Zhuohan Li committed over 2 years ago

[Bugfix] fix type hint for py 3.8 (#4036)

youkaichao committed over 2 years ago

[Doc] Add typing hints / mypy types cleanup (#3816)

Michael Feil committed over 2 years ago

Fix echo/logprob OpenAI completion bug (#3441)

Dylan Hawk committed over 2 years ago

punica fix-bgmv-kernel-640 (#4007)

fuchen.ljl committed over 2 years ago

[Kernel] Fused MoE Config for Mixtral 8x22 (#4002)

Roger Wang committed over 2 years ago

[Misc] Add indirection layer for custom ops (#3913)

Kunshang Ji committed over 2 years ago

[Test] Add xformer and flash attn tests (#3961)

SangBin Cho committed over 2 years ago

[Core][5/N] Fully working chunked prefill e2e (#3884)

SangBin Cho committed over 2 years ago

← Newer Page 1066 of 1120 Older →