@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 20:45 UTC

main

[Bugfix]fix modelscope compatible issue (#6730)

liuyhwangyh committed over 2 years ago

[Bugfix] Fix token padding for chameleon (#6724)

Roger Wang committed over 2 years ago

[build] relax wheel size limit (#6704)

youkaichao committed over 2 years ago

[Model] Pipeline Parallel Support for DeepSeek v2 (#6519)

Travis Johnson committed over 2 years ago

Bump version to 0.5.3.post1 (#6696)

Simon Mo committed over 2 years ago

[BugFix] Fix RoPE error in Llama 3.1 (#6693)

Woosuk Kwon committed over 2 years ago

[Bugfix] Fix a log error in chunked prefill (#6694)

Woosuk Kwon committed over 2 years ago

← Newer Page 1018 of 1120 Older →