@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 06:45 UTC

main

Use `quantization_config` in hf config (#1695)

Woosuk Kwon committed almost 3 years ago

Support Min P Sampler (#1642)

Roy committed almost 3 years ago

[Minor] Fix comment (#1704)

Zhuofan committed almost 3 years ago

[Fix] Fix comm test (#1691)

Zhuohan Li committed about 3 years ago

Return usage for openai streaming requests (#1663)

Iskren Ivov Chernev committed about 3 years ago

[Fix] Update Supported Models List (#1690)

Zhuohan Li committed about 3 years ago

Support Microsoft Phi 1.5 (#1664)

maximzubkov committed about 3 years ago

feat(config): support parsing torch.dtype (#1641)

Aaron Pham committed about 3 years ago

Revert `MptConfig` to `MPTConfig` (#1668)

Megha Agarwal committed about 3 years ago

Add DeepSpeed MII backend to benchmark script (#1649)

Woosuk Kwon committed about 3 years ago

Dockerfile: Upgrade Cuda to 12.1 (#1609)

GhaziSyed committed about 3 years ago

Add Yi model to quantization support (#1600)

forpanyang committed about 3 years ago

← Newer Page 1097 of 1120 Older →