@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 9, 14:45 UTC

main

[GLM-OCR] GLM-OCR with MTP Support (#33005)

Yuxuan Zhang committed 10 months ago

[Misc] HF Hub LoRA Resolver (#20320)

Alex Brooks committed 10 months ago

Set splitk=1 for fused-moe-lora expand kernel (#32882)

Danielle Robinson committed 10 months ago

[Tests] Remove Duplicates (#33032)

Robert Shaw committed 10 months ago

[StepVL] support close img patch (#32923)

ltd0924 committed 10 months ago

← Newer Page 456 of 1120 Older →