@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 04:30 UTC

main

[Doc] Improve GitHub links (#11491)

Cyrus Leung committed almost 2 years ago

[Misc] Move weights mapper (#11443)

Jee Jee Li committed almost 2 years ago

[OpenVINO] Fixed installation conflicts (#11458)

Ilya Lavrenov committed almost 2 years ago

[Bugfix] Fix Qwen2-VL LoRA weight loading (#11430)

Jee Jee Li committed almost 2 years ago

[Frontend] Online Pooling API (#11457)

Cyrus Leung committed almost 2 years ago

[V1] TP Ray executor (#11107)

Rui Qiao committed almost 2 years ago

[Docs] Convert rST to MyST (Markdown) (#11145)

Rafael Vasquez committed almost 2 years ago

[Bugfix] Add kv cache scales to gemma2.py (#11269)

Michael Goin committed almost 2 years ago

[Misc] add w8a8 asym models (#11075)

Dipika Sikka committed almost 2 years ago

← Newer Page 925 of 1120 Older →