@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 04:15 UTC

main

Re-enable the 80 char line width limit (#3305)

Zhuohan Li committed over 2 years ago

[Fix] Fix best_of behavior when n=1 (#3298)

Nick Hill committed over 2 years ago

[FIX] Fix prefix test error on main (#3286)

Zhuohan Li committed over 2 years ago

[FIX] Make `flash_attn` optional (#3269)

Woosuk Kwon committed over 2 years ago

[Docs] Fix Unmocked Imports (#3275)

Roger Wang committed over 2 years ago

Feature add lora support for Qwen2 (#3177)

whyiug committed over 2 years ago

Fix auto prefix bug (#3239)

ElizaWszola committed over 2 years ago

Measure model memory usage (#3120)

Michael Goin committed over 2 years ago

Separate attention backends (#3005)

Woosuk Kwon committed over 2 years ago

Add GPTQ support for Gemma (#3200)

TechxGenus committed over 2 years ago

Add tqdm `dynamic_ncols=True` (#3242)

Chujie Zheng committed over 2 years ago

← Newer Page 1078 of 1120 Older →