@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 04:15 UTC

main

fix relative import path of protocol.py (#3134)

Huarong committed over 2 years ago

Remove exclude_unset in streaming response (#3143)

Seonghyeon committed over 2 years ago

Add guided decoding for OpenAI API server (#2819)

felixzhu555 committed over 2 years ago

Fix building from source on WSL (#3112)

Billy Cao committed over 2 years ago

Support starcoder2 architecture (#3089)

Seonghyeon committed over 2 years ago

Add LoRA support for Gemma (#3050)

Woosuk Kwon committed over 2 years ago

multi-lora documentation fix (#3064)

Ganesh Jagadeesan committed over 2 years ago

Support logit bias for OpenAI API (#3027)

Dylan Hawk committed over 2 years ago

[Minor] Fix type annotation in fused moe (#3045)

Woosuk Kwon committed over 2 years ago

← Newer Page 1080 of 1120 Older →