@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

main

Fix `validate-config` pre-commit check (#25157)

Harry Mellor committed about 1 year ago

[Model] Improve Pooling Model (#25149)

Jee Jee Li committed about 1 year ago

[Doc] Fix cross-reference warnings (#25058)

Punitvara committed about 1 year ago

Add 'path' option to ImagePrompt data_format (#25081)

Gerard Finol committed about 1 year ago

[Docs] Fix API Reference (#25140)

Harry Mellor committed about 1 year ago

[Spec Decode] Efficient padded speculation (#24539)

Benjamin Chislett committed about 1 year ago

← Newer Page 640 of 1120 Older →