@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

[V0 Deprecation] Remove more V0 tests (#25117)

Woosuk Kwon committed about 1 year ago

[XPU] Whisper model support on XPU Platform (#25123)

Chaojun Zhang committed about 1 year ago

[Core][MM] Cleanup `MultiModalCache` (#25006)

Lukas Geiger committed about 1 year ago

[Docs] Clean up the contributing README (#25099)

Harry Mellor committed about 1 year ago

[Kernels] Enable DeepGEMM by default (#24462)

bnellnm committed about 1 year ago

[V0 Deprecation] Skip PP test (#25128)

Woosuk Kwon committed about 1 year ago

[V0 Deprecation] Remove misc V0 tests (#25118)

Woosuk Kwon committed about 1 year ago

[V0 Deprecation] Remove V0 Engine tests (#25114)

Woosuk Kwon committed about 1 year ago

Add a batched auto tune script (#25076)

Karan Goel committed about 1 year ago

← Newer Page 641 of 1120 Older →