@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 09:30 UTC

main

[CI/Build] Add bot to close stale issues and PRs (#9436)

Russell Bryant committed about 2 years ago

[Model] Add Qwen2-Audio model support (#9248)

Yunfei Chu committed about 2 years ago

[Bugfix] Fix divide by zero when serving Mamba models (#9617)

Tyler Michael Smith committed about 2 years ago

[Hardware][XPU] using current_platform.is_xpu (#9605)

Mengqing Cao committed about 2 years ago

[Build] Fix `FetchContent` multiple build issue (#9596)

Luka Govedič committed about 2 years ago

[Model] Support E5-V (#9576)

Cyrus Leung committed about 2 years ago

[Misc] Make benchmarks use EngineArgs (#9529)

Jeremy Arnold committed about 2 years ago

← Newer Page 965 of 1120 Older →