@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 04:45 UTC

main

raise exception for pin_lora (#19809)

Ning Xie committed over 1 year ago

[Misc] [ROCm] Prevent surplus tensor reshape (#19803)

zsolt-borbely-htec committed over 1 year ago

Mark invariant normalizer in Gemma as non-persistent (#19788)

Yu-Hang "Maxin" Tang committed over 1 year ago

[Bugfix] Add check_health to v1 async client. (#19821)

kourosh hakhamaneshi committed over 1 year ago

[Bugfix] Fix the linter (#19826)

Lu Fang committed over 1 year ago

Support embedding models in V1 (#16188)

Maximilien de Bayser committed over 1 year ago

Fix FA2 fallback for Blackwell V1 (#19781)

Michael Goin committed over 1 year ago

[BugFix] Fix use_cudagraph=False (#19612)

Richard Zou committed over 1 year ago

[Core] Do not copy array during hashing (#19484)

Lukas Geiger committed over 1 year ago

docs: fix Slack bulletpoint in README (#19811)

Nathan Weinberg committed over 1 year ago

[v1] Support mamba2 (#19327)

Chen Zhang committed over 1 year ago

← Newer Page 760 of 1120 Older →