[ROCm][CI][Docs] Add comment explaining TRITON_ATTN fallback for ROCm (#32835)

Andreas Karatzas committed 10 months ago

[ROCm][CI] Fix AITER test flakiness by using explicit attention backend (#32346)

Andreas Karatzas committed 10 months ago

[ROCm][CI] Lower Acceptance Len Threshold For test_draft_model_quantization (#32731)

Micah Williamson committed 10 months ago

Upgrade transformers-4.57.5 (#32287)

Huy Do committed 10 months ago

[Llama.py -> mistral.py] Extract mistral-only relevant code into separate file (#32780)

Patrick von Platen committed 10 months ago

[FlashMLA] Update FlashMLA to expose new arguments (#32810)

Lucas Wilkinson committed 10 months ago

[ROCm][CI] fix get_valid_backends (#32787)

Divakar Verma committed 10 months ago

[Docs] Remove outdated async_scheduling limitation with speculative decoding (#32775)

Ifta khairul Alam Adil committed 10 months ago

Cleanup some huggingface_hub-related stuff (#32788)

Lucain committed 10 months ago

[EC Connector] Optimize remote cache check in scheduler (#32585)

knlnguyen1802 committed 10 months ago

[Bugfix] Fix potential EAGLE spec decode segfault during graph capture (#32818)

Matt committed 10 months ago

[Deprecation] Remove deprecated environment variables (#32812)

Wentao Ye committed 10 months ago

[Model Runner V2] Do not error on attention backends (#32820)

Woosuk Kwon committed 10 months ago

[Model Runner V2] Refactor Prompt Logprobs (#32811)

Woosuk Kwon committed 10 months ago

[Kernel] Add topk_sigmoid kernel (#31246)

Xin Yang committed 10 months ago

[Misc] Add Helion version check to collect_env (#32797)

Yanan Cao committed 10 months ago

[ModelRunner V2] Don't pin reused flashinfer tensors (#32799)

Nick Hill committed 10 months ago

[ROCm] fix import for on_gfx9 (#32783)

Divakar Verma committed 10 months ago

Add missing import of fused_topk to benchmark_moe (#32784)

danisereb committed 10 months ago

[Model Runner V2] Minor refactor for `compute_slot_mappings` (#32794)

Woosuk Kwon committed 10 months ago