@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 12, 21:00 UTC

main

[ci][amd] fix EPLB execution test (#28742)

Bradley D committed 12 months ago

[Frontend] Allow parsed tool arguments (#28820)

Quentin Gallouédec committed 12 months ago

[torchao] fix safetensors for sharding (#28169)

liangel-02 committed 12 months ago

[Misc] Colorize logs (#29017)

Nick Hill committed 12 months ago

[Refactor] Optimize `select_experts` (#28069)

Wentao Ye committed 12 months ago

← Newer Page 547 of 1120 Older →