@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 09:45 UTC

main

[Frontend] Fix chat template content format detection (#18190)

Sebastian Schoennenbeck committed over 1 year ago

add tools into TokenizeChatRequest (#18187)

hustxiayang committed over 1 year ago

fix: typos (#18151)

omahs committed over 1 year ago

[UT] Add ut for none hash (#17892)

Ning Xie committed over 1 year ago

Update deprecated type hinting in `models` (#18132)

Harry Mellor committed over 1 year ago

[Misc] add lobe-chat support (#18177)

Reid committed over 1 year ago

[Chore] astral's ty (#18116)

Aaron Pham committed over 1 year ago

[V1][Metrics] Remove unused code (#18158)

Mark McLoughlin committed over 1 year ago

← Newer Page 794 of 1120 Older →