@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 10:45 UTC

main

[core] remove beam search from the core (#9105)

youkaichao committed about 2 years ago

[Frontend] API support for beam search (#9087)

Brendan Wong committed about 2 years ago

[core] use forward context for flash infer (#9097)

youkaichao committed about 2 years ago

[Model] Support Gemma2 embedding model (#9004)

Xin Yang committed about 2 years ago

[Doc] Update README.md with Ray summit slides (#9088)

Zhuohan Li committed about 2 years ago

← Newer Page 975 of 1120 Older →