@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 22:00 UTC

main

[ Misc ] Clean Up `CompressedTensorsW8A8` (#6113)

Robert Shaw committed over 2 years ago

[vlm] Remove vision language config. (#6089)

xwjiang2010 committed over 2 years ago

[Bugfix] Fix `compute_logits` in Jamba (#6093)

Roger Wang committed over 2 years ago

[Doc] Fix Mock Import (#6094)

Roger Wang committed over 2 years ago

[misc][distributed] error on invalid state (#6092)

youkaichao committed over 2 years ago

[CI] Fix base url doesn't strip "/" (#6087)

SangBin Cho committed over 2 years ago

[Core] Dynamic image size support for VLMs (#5276)

Cyrus Leung committed over 2 years ago

[Model] Jamba support (#4115)

Mor Zusman committed over 2 years ago

[CORE] Quantized lm-head Framework (#4442)

Qubitium-ModelCloud committed over 2 years ago

Update conftest.py (#6076)

Robert Shaw committed over 2 years ago

[Core] Pipeline Parallel Support (#4412)

Murali Andoorveedu committed over 2 years ago

[Doc] Reinstate doc dependencies (#6061)

Cyrus Leung committed over 2 years ago

← Newer Page 1030 of 1120 Older →