@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 22:00 UTC

main

Unmark more files as executable (#5962)

Tyler Michael Smith committed over 2 years ago

Support Deepseek-V2 (#4650)

wangding zeng committed over 2 years ago

[Bugfix] Fix compute datatype for cutlass 3.x epilogues (#5931)

Tyler Michael Smith committed over 2 years ago

[CI/Build] [2/3] Reorganize entrypoints tests (#5904)

Cyrus Leung committed over 2 years ago

[Hardware][Intel] OpenVINO vLLM backend (#5379)

Ilya Lavrenov committed over 2 years ago

Unmark fused_moe config json file as executable (#5960)

Tyler Michael Smith committed over 2 years ago

[Core] Registry for processing model inputs (#5214)

Cyrus Leung committed over 2 years ago

[Hardware][TPU] Optimize KV cache swapping (#5878)

Woosuk Kwon committed over 2 years ago

[core][misc] remove logical block (#5882)

youkaichao committed over 2 years ago

← Newer Page 1033 of 1120 Older →