@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 22:00 UTC

main

[Frontend]: Support base64 embedding (#5935)

llmpros committed over 2 years ago

[ci][distributed] fix device count call

youkaichao committed over 2 years ago

[CI/Build] [3/3] Reorganize entrypoints tests (#5966)

Cyrus Leung committed over 2 years ago

[ CI/Build ] LM Eval Harness Based CI Testing (#5838)

Robert Shaw committed over 2 years ago

[CI/Build] Add TP test for vision models (#5892)

Cyrus Leung committed over 2 years ago

[Misc] Update Phi-3-Vision Example (#5981)

Roger Wang committed over 2 years ago

[Bugfix] Fix precisions in Gemma 1 (#5913)

Woosuk Kwon committed over 2 years ago

[Misc] Extend vLLM Metrics logging API (#5925)

William Lin committed over 2 years ago

[Bugfix][TPU] Fix pad slot id (#5977)

Woosuk Kwon committed over 2 years ago

[Bugfix][TPU] Fix TPU sampler output (#5978)

Woosuk Kwon committed over 2 years ago

← Newer Page 1032 of 1120 Older →