@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 07:00 UTC

main

[Doc] Fix typo in arg_utils.py (#10264)

Xin Yang committed about 2 years ago

Bump to compressed-tensors v0.8.0 (#10279)

Dipika Sikka committed about 2 years ago

[V1] Support VLMs with fine-grained scheduling (#9871)

Woosuk Kwon committed about 2 years ago

[core][distributed] use tcp store directly (#10275)

youkaichao committed about 2 years ago

[V1] Fix CI tests on V1 engine (#10272)

Woosuk Kwon committed about 2 years ago

Revert "[ci][build] limit cmake version" (#10271)

youkaichao committed about 2 years ago

[doc] improve debugging doc (#10270)

youkaichao committed about 2 years ago

[doc] fix location of runllm widget (#10266)

youkaichao committed about 2 years ago

[LoRA] Adds support for bias in LoRA (#5733)

Umesh committed about 2 years ago

← Newer Page 950 of 1120 Older →