@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 10, 10:15 UTC

main

Fix type error (#31999)

Adolfo Victoria committed 10 months ago

[ROCm][PD] add moriio kv connector. (#29304)

inkcherry committed 10 months ago

[Bugfix] Fix Triton FusedMoE LoRA (#30585)

Xin Yang committed 10 months ago

[Model] Reorganize pooling layers (#31973)

Cyrus Leung committed 10 months ago

[Bugfix] Fix OpenAPI schema test failures (#31921)

Andreas Karatzas committed 10 months ago

← Newer Page 479 of 1120 Older →