[torch.compile] Rename `compile_ranges_split_points` to `compile_ranges_endpoints` (#36027)

Copilot committed 8 months ago

Fix/resupport nongated fused moe triton (#36412)

Shaun Kotek committed 8 months ago

[Docs] Expand --allowed-media-domains security guidance with threat details (#36506)

Russell Bryant committed 8 months ago

[Model Runner V2] Add dummy profile_cudagraph_memory API (#36520)

Woosuk Kwon committed 8 months ago

[ROCm][CI] Fix logprob divergence for TitanML/tiny-mixtral under AITER rms_norm (#36101)

Andreas Karatzas committed 8 months ago

[ROCm][CI] Fix ROCm attention backend validation for head sizes, block sizes, and compute capability checks (#36292)

Andreas Karatzas committed 8 months ago

[Misc] fix typo: dependant -> dependent (2 lines change) (#36511)

SoluMilken committed 8 months ago

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)

Roberto L. Castro committed 8 months ago

[Attention][Perf] Optimize cp_gather_and_upconvert_fp8_kv_cache - DeepSeek-v3.2 (#35290)

Roberto L. Castro committed 8 months ago

[ROCM] Optimize the fused_topk_bias to use aiter instead of fallback torch ops. (#36253)

Taoyu Zhu committed 8 months ago

[CI] Fix edge case that could lead to broken docs builds on main (#36515)

Harry Mellor committed 8 months ago

[Bugfix] Clear stale CG keys after memory profiling (#36416)

Matthew Bonanni committed 8 months ago

[Refactor] Simplify `chat_completion_full_generator` for tool parsers (#35634)

Wentao Ye committed 8 months ago

[Bug] Fix pooling model benchmark script (#36300)

Wentao Ye committed 8 months ago

Reapply [Attention] Refactor `check_and_update_config` (#35122)

Matthew Bonanni committed 8 months ago

Support online use_audio_in_video (#36319)

Tianyu Guo committed 8 months ago

[Frontend] Move warmup into Renderer (#36482)

Cyrus Leung committed 8 months ago

[MM Encoder] Default to use TORCH_SDPA backend for ViT on Volta/Turing GPU (#36472)

Isotr0py committed 8 months ago

[ci] Bound openai dependency to 2.24.0 (#36471)

Kevin H. Luu committed 8 months ago

[Deprecation][1/2] Remove items deprecated in v0.18 (#36470)

Cyrus Leung committed 8 months ago