@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 00:30 UTC

main

[Kernel] Update Cutlass fp8 configs (#5144)

Varun Sundar Rabindranath committed over 2 years ago

[Misc]: optimize eager mode host time (#4196)

functionxu123 committed over 2 years ago

[Model] Support MAP-NEO model (#5081)

SnowDist committed over 2 years ago

Fix cutlass sm_90a vesrion in CMakeList

simon-mo committed over 2 years ago

[Build] Disable sm_90a in cu11 (#5141)

Simon Mo committed over 2 years ago

Bump version to v0.4.3 (#5046)

Simon Mo committed over 2 years ago

add doc about serving option on dstack (#3074)

Chansung Park committed over 2 years ago

[Bugfix] Automatically Detect SparseML models (#5119)

Robert Shaw committed over 2 years ago

← Newer Page 1048 of 1120 Older →