[Docs] Simplify CPU x86 Docker build documentation (#33071)

Maryam Tahhan committed 10 months ago

[ROCm] Enabling forward_includes_kv_cache on ROCm MHA backends (#33106)

Gregory Shtrasberg committed 10 months ago

Adds FunAudioChat multimodal audio model support (#2) (#33058)

ramos committed 10 months ago

[Bugfix] Lazy import NgramProposer in GPU model runner (#32821)

22quinn committed 10 months ago

Don't use `min_pixels`/`max_pixels` from Qwen2VL's processor (#33208)

Harry Mellor committed 10 months ago

Add flake8-implicit-str-concat rules to Ruff (#33191)

Harry Mellor committed 10 months ago

Relax protobuf library version constraints (#33202)

Jeffrey Wang committed 10 months ago

[ROCm][CI] Add TORCH_NCCL_BLOCKING_WAIT For Distributed Tests (A100) (#32891)

Micah Williamson committed 10 months ago

[Feature]: Container image WORKDIR consistency (#33159)

Xinan Miao committed 10 months ago

[Docs] Use definition lists for CLI reference docs (#33186)

Harry Mellor committed 10 months ago

[docs] Improve tlparse section (#33211)

Angela Yi committed 10 months ago

[CI] minor fixes to pipeline generator and tests (#33151)

Kevin H. Luu committed 10 months ago

[Model Runner V2] Use a different stream for grammar bitmask h2d copy (#33059)

Woosuk Kwon committed 10 months ago

Add attention benchmarking tools (#26835)

Matthew Bonanni committed 10 months ago

[torch.compile] Speed up MOE handling in forward_context (#33184)

Richard Zou committed 10 months ago

[Perf] Optimize dcp allocate tensor (#33102)

Wentao Ye committed 10 months ago

[Bugfix] Fix display error (inconsistent with context) (#33020)

linhaifeng committed 10 months ago

Enabling "2 node" distributed tests in the AMD CI pipeline. (#32719)

Alexei-V-Ivanov-AMD committed 10 months ago

[Attention] Use `has_flashinfer` helper (#33177)

Matthew Bonanni committed 10 months ago

feature: support eagle3 for HunyuanVL & Hunyuan (#33035)

Iris committed 10 months ago