@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 04:15 UTC

main

Bump up version to v0.3.2 (#2968)

Zhuohan Li committed over 2 years ago

Support per-request seed (#2514)

Nick Hill committed over 2 years ago

[ROCm] Upgrade transformers to v4.38.0 (#2967)

Woosuk Kwon committed over 2 years ago

[FIX] Add Gemma model to the doc (#2966)

Zhuohan Li committed over 2 years ago

Upgrade transformers to v4.38.0 (#2965)

Woosuk Kwon committed over 2 years ago

Add Gemma model (#2964)

Xiang Xu committed over 2 years ago

Add metrics to RequestOutput (#2876)

Antoni Baum committed over 2 years ago

Make vLLM logging formatting optional (#2877)

Antoni Baum committed over 2 years ago

[FIX] Fix beam search test (#2930)

Zhuohan Li committed over 2 years ago

[ROCm] include gfx908 as supported (#2792)

James Whedbee committed over 2 years ago

Fix `vllm:prompt_tokens_total` metric calculation (#2869)

Ronen Schaffer committed over 2 years ago

Support OLMo models. (#2832)

Isotr0py committed over 2 years ago

[Test] Add basic correctness test (#2908)

Zhuohan Li committed over 2 years ago

Defensively copy `sampling_params` (#2881)

Nick Hill committed over 2 years ago

Bump up to v0.3.1 (#2887)

Woosuk Kwon committed over 2 years ago

Prefix Caching- fix t4 triton error (#2517)

shiyi.c_98 committed over 2 years ago

← Newer Page 1082 of 1120 Older →