@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 23:45 UTC

Code Commits 22,390 Issues Pulls Cloud Agent CICD
main
main

[Model] Prioritize Transformers fallback over suffix matching (#21719)

Cyrus Leung committed over 1 year ago

a4ed731546

Migrate KeyeImageInputs and KeyeVideoInputs to TensorSchema (#21686)

Benji Beck committed over 1 year ago

d128d0d554

[v1][mamba] Added mamba_type into MambaSpec (#21715)

Asaf Joseph Gardin committed over 1 year ago

a6c050286a

[BugFix] Fix ChunkedLocalAttention when the hybrid kv-cache is disabled (#21707)

Lucas Wilkinson committed over 1 year ago

139a7f07bd

[Bugfix] fix max-file-size type from str to int (#21675)

Ning Xie committed over 1 year ago

150d9e6337

[Bugfix] Fix shape checking for Fuyu (#21709)

Cyrus Leung committed over 1 year ago

139a97ec56

[bugfix] fix profile impact benchmark results (#21507)

rongfu.leng committed over 1 year ago

18cc33dd60

[Bugfix] [issue-21565] Fix the incompatibility issue with stream and named function calling when Thinking is disabled (#21573)

Hongsheng Liu committed over 1 year ago

7656cf4cf3

Migrate Idefics3ImagePixelInputs and Idefics3ImageEmbeddingInputs to … (#21683)

Benji Beck committed over 1 year ago

3ea57a56d9

Migrate GraniteSpeechAudioInputs to TensorSchema (#21682)

Benji Beck committed over 1 year ago

75856bc2cb

Migrate GLMVImagePixelInputs to TensorSchema (#21679)

Benji Beck committed over 1 year ago

304dcdf575

Migrate Glm4vImageInputs, Glm4vVideoInputs to TensorSchema (#21678)

Benji Beck committed over 1 year ago

88e46c7c8d

Migrate Gemma3ImagePixelInputs to TensorSchema (#21676)

Benji Beck committed over 1 year ago

d8937de4c8

[FEAT] [ROCm] [AITER]: Add AITER HIP block quant kernel (#21242)

TJian committed over 1 year ago

e626d286f5

[Model] Support TP/PP/mamba2 kernel for PLaMo2 (#19674)

Shinichi Hemmi committed over 1 year ago

c7ffe93d9c

[V1] Exception Handling when Loading KV Cache from Remote Store (#21534)

Adeline committed over 1 year ago

15a72ac478

[Misc] Add fused_moe configs for Qwen3-Coder-480B-A35B-Instruct-FP8 (#21700)

Jee Jee Li committed over 1 year ago

04ff4be310

Fix GLM tool parser (#21668)

Yuxuan Zhang committed over 1 year ago

93269bb43e

Fix typo for limit-mm-per-prompt in docs (#21697)

Joachim Studnia committed over 1 year ago

82acf2184d

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470)

Cyrus Leung committed over 1 year ago

86ae693f20
← Newer Page 718 of 1120 Older →