@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 00:30 UTC

main

[Model] Add support for falcon-11B (#5069)

Isotr0py committed over 2 years ago

[Core] Allow AQLM on Pascal (#5058)

sasha0552 committed over 2 years ago

[Misc] add logging level env var (#5045)

youkaichao committed over 2 years ago

[Bugfix] Fix Mistral v0.3 Weight Loading (#5005)

Robert Shaw committed over 2 years ago

[Doc] add ccache guide in doc (#5012)

youkaichao committed over 2 years ago

[Core][1/N] Support send/recv in PyNCCL Groups (#4988)

Murali Andoorveedu committed over 2 years ago

[Model] LoRA gptbigcode implementation (#3949)

raywanb committed over 2 years ago

← Newer Page 1050 of 1120 Older →