@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 03:00 UTC

main

[CI/CD] add neuron docker and ci test scripts (#3571)

Liangfu Chen committed over 2 years ago

[Misc] Bump transformers to latest version (#4176)

Nick Hill committed over 2 years ago

Allow model to be served under multiple names (#2894)

Harry Mellor committed over 2 years ago

[Core] nccl integrity check and test (#4155)

youkaichao committed over 2 years ago

[Typing] Mypy typing part 2 (#4043)

SangBin Cho committed over 2 years ago

[Kernel] Add punica dimension for Swallow-MS-7B LoRA (#4134)

Shoichi Uchinami committed over 2 years ago

[CI] Move CPU/AMD tests to after wait (#4123)

Cade Daniel committed over 2 years ago

[Misc] [CI] Fix CI failure caught after merge (#4126)

Cade Daniel committed over 2 years ago

[Core] Refactor model loading code (#4097)

Antoni Baum committed over 2 years ago

[Core] Fix engine-use-ray broken (#4105)

SangBin Cho committed over 2 years ago

← Newer Page 1064 of 1120 Older →