@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

Document aarch64 CPU support works (#22646)

Eric Curtin committed over 1 year ago

[Model] NemotronH Support (#22349)

danielafrimi committed over 1 year ago

[Misc] Move jsontree to utils (#22622)

Cyrus Leung committed over 1 year ago

[Misc] Move tensor schema tests (#22612)

Cyrus Leung committed over 1 year ago

Support token_type_ids in V1 with less code changes (#21985)

Maximilien de Bayser committed over 1 year ago

Migrate LlavaImageInputs to TensorSchema (#21770)

Benji Beck committed over 1 year ago

← Newer Page 697 of 1120 Older →