A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 14, 05:30 UTC
main
Migrate tarsier inputs to TensorSchema (#23500)
Benji Beck committed about 1 year ago
[Misc] Unified linear print info (#23516)
Jee Jee Li committed about 1 year ago
[Bugfix] Fix Qwen2.5-VL quantized model weights loading (#23512)
zifeitong committed about 1 year ago
Frontend: Adding LM Format Enforcer support to V1 engine (#22564)
Noam Gat committed about 1 year ago
[Perf] Add Triton config for DeepSeek V3 FP8 EP32 H200 (#23504)
Ming Yang committed about 1 year ago
[Doc: ]fix various typos in multiple files (#23487)
Didier Durand committed about 1 year ago
fix incompatibililty with non cuda platform for nvfp4 (#23478)
Lucia Fang committed about 1 year ago
[Misc] Remove unused slot_mapping buffer (#23502)
Woosuk Kwon committed about 1 year ago
[Model] Enable BLOOM on V1 (#23488)
Cyrus Leung committed about 1 year ago
[New Model]Donut model (#23229)
汪志鹏 committed about 1 year ago
(Misc): add missing test for zero truncation size. (#23457)
TeeKen Lau committed about 1 year ago
[Misc] update dict parse to EPLBConfig from json dumps to dict unpacking (#23305)
rongfu.leng committed about 1 year ago
[kernel] Support W4A8 on Hopper (#23198)
czhu-cohere committed about 1 year ago
Migrate Paligemma inputs to TensorSchema (#23470)
Benji Beck committed about 1 year ago
[Bugfix] Add strong reference to CUDA pluggable allocator callbacks (#23477)
22quinn committed about 1 year ago
Migrate Pixtral inputs to TensorSchema (#23472)
Benji Beck committed about 1 year ago
[gpt-oss] Streaming Output for Python Tool (#23409)
Jiangyun Zhu committed about 1 year ago
[Misc] Modify CacheConfig import (#23459)
Jee Jee Li committed about 1 year ago
Support DeepSeek-V3.1 tool call (#23454)
Xu Wenqing committed about 1 year ago
fix(tests): Correct unreachable assertion in truncation test (#23425)
Aziz committed about 1 year ago