@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[V0 Deprecation] Remove V0 MP executor (#25329)

Woosuk Kwon committed about 1 year ago

[V0 Deprecation] Remove V0 core (#25321)

Woosuk Kwon committed about 1 year ago

[CI] Skip tests failing on main (#25326)

Woosuk Kwon committed about 1 year ago

[Chore] Remove unused sampler in models (#25324)

Woosuk Kwon committed about 1 year ago

[V0 Deprecation] Remove V0 Output Processor (#25320)

Woosuk Kwon committed about 1 year ago

[V0 Deprecation] Remove LLMEngine (#25033)

Woosuk Kwon committed about 1 year ago

[V1] Support `LLM.apply_model` (#18465)

Cyrus Leung committed about 1 year ago

← Newer Page 635 of 1120 Older →