@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 06:45 UTC

main

Support Longchat and RoPE scaling (#555)

Lily Liu committed about 3 years ago

Add comments on RoPE initialization (#1176)

Woosuk Kwon committed about 3 years ago

Align `max_tokens` behavior with openai (#852)

Wen Sun committed about 3 years ago

Fix config for Falcon (#1164)

Woosuk Kwon committed about 3 years ago

[FIX] Simplify sampler logic (#1156)

Zhuohan Li committed about 3 years ago

[Sampler] Vectorized sampling (simplified) (#1048)

Zhuohan Li committed about 3 years ago

Announce the First vLLM Meetup (#1148)

Woosuk Kwon committed about 3 years ago

Docs: Fix broken link to openai example (#1145)

Nick Perez committed about 3 years ago

feat: support stop_token_ids parameter. (#1097)

Ricardo Lu committed about 3 years ago

Add float16 and float32 (#1115)

Woosuk Kwon committed about 3 years ago

Replace DtypeTensor (#1123)

Woosuk Kwon committed about 3 years ago

Add documentation to Triton server tutorial (#983)

Tanmay Verma committed about 3 years ago

[Community] Add vLLM Discord server (#1086)

Zhuohan Li committed about 3 years ago

← Newer Page 1102 of 1120 Older →