@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 23:15 UTC

main

[Model] Initialize Phi-3-vision support (#4986)

Isotr0py committed over 2 years ago

Correct alignment in the seq_len diagram. (#5592)

Charles Riggins committed over 2 years ago

[Model] Rename Phi3 rope scaling type (#5595)

Amit Garg committed over 2 years ago

Fix w8a8 benchmark and add Llama-3-8B (#5562)

Cody Yu committed over 2 years ago

[build][misc] limit numpy version (#5582)

youkaichao committed over 2 years ago

[Fix] Correct OpenAI batch response format (#5554)

zifeitong committed over 2 years ago

← Newer Page 1039 of 1120 Older →