@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 08:15 UTC

main

bugfix: fix the bug that stream generate not work (#2756)

Zhao Yingzhuo committed about 2 years ago

[bugfix] fix broken tests of mlp speculator (#10177)

youkaichao committed about 2 years ago

[CI/Build] Add run-hpu-test.sh script (#10167)

Chendi.Xue committed about 2 years ago

[5/N] pass the whole config to model (#9983)

youkaichao committed about 2 years ago

[Doc] Adjust RunLLM location (#10176)

Cyrus Leung committed about 2 years ago

[torch.compile] Fuse RMSNorm with quant (#9138)

Luka Govedič committed about 2 years ago

Rename vllm.logging to vllm.logging_utils (#10134)

Florian Zimmermeister committed about 2 years ago

[V1] Fix non-cudagraph op name (#10166)

Woosuk Kwon committed about 2 years ago

[Misc] Improve Web UI (#10090)

Rafael Vasquez committed about 2 years ago

Fix edge case Mistral tokenizer (#10152)

Patrick von Platen committed about 2 years ago

← Newer Page 953 of 1120 Older →