A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
main
correct LWS deployment yaml (#23104)
Christian Berge committed about 1 year ago
[CI]: reduce HTTP calls inside entrypoints openai tests (#23646)
Aziz committed about 1 year ago
[Model] Support dp on ViT on GLM-4.5V (#23168)
WeiQing Chen committed about 1 year ago
[Doc]: fix typos in Python comments (#24077)
Didier Durand committed about 1 year ago
Migrate Interns1 inputs to TensorSchema (#23510)
Benji Beck committed about 1 year ago
[XPU][Feature] fp8 online quantization support for XPU (#23148)
Yan Ma committed about 1 year ago
Migrate OvisImagePatchInputs to TensorSchema (#22024)
Benji Beck committed about 1 year ago
Remove runtime checks based on pooling params (#24051)
Maximilien de Bayser committed about 1 year ago
[Bugfix] Fix the issue that Blip2ForConditionalGeneration' object has… (#24028)
damon committed about 1 year ago
[V1][Mamba1] - FP32 SSM Kernel Support (#23506)
Asaf Joseph Gardin committed about 1 year ago
[Doc]: fix typos in Python comments (#24042)
Didier Durand committed about 1 year ago
[bugfix]fix MTP hidden states (#24056)
Lucia Fang committed about 1 year ago
[Chore][V0 Deprecation] Move LogProb to a separate file (#24055)
Woosuk Kwon committed about 1 year ago
[Model] Support DP for ViT on Kimi-VL-A3B-Thinking-2506 (#23817)
WeiQing Chen committed about 1 year ago
[docs][misc] IOProcessor plugins fixes (#24046)
Christian Pinto committed about 1 year ago
[Misc] Minor code simplification for spec decode (#24053)
Woosuk Kwon committed about 1 year ago
Document multi-proc method selection for profiling (#23802)
Julien Debache committed about 1 year ago
[Model]: support KeyeVL-1_5-8B (#23838)
Kwai-Keye committed about 1 year ago
[Doc]: Fix CPU install docs: force torch-backend=cpu to avoid GPU torchvision errors (#24033)
Kay Yan committed about 1 year ago
[Frontend] Gemma3n audio `transcriptions`/`translations` endpoint (#23735)
Nicolò Lucchesi committed about 1 year ago