@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 04:30 UTC

main

[Model] Add support for embedding model GritLM (#10816)

Pooya Davoodi committed almost 2 years ago

[Core] cleanup zmq ipc sockets on exit (#11115)

Russell Bryant committed almost 2 years ago

[Docs] Add media kit (#11121)

Simon Mo committed almost 2 years ago

[V1] VLM preprocessor hashing (#11020)

Alexander Matveev committed almost 2 years ago

[CI/Build] Split up VLM tests (#11083)

Cyrus Leung committed almost 2 years ago

[torch.compile] remove graph logging in ci (#11110)

youkaichao committed almost 2 years ago

[CI/Build] Enable prefix caching test for AMD (#11098)

hissu-hyvarinen committed almost 2 years ago

[Doc] Update docs to refer to pooling models (#11093)

Cyrus Leung committed almost 2 years ago

[Misc] Split up pooling tasks (#10820)

Cyrus Leung committed almost 2 years ago

← Newer Page 932 of 1120 Older →