[BugFix] Fix multi async save in MultiConnector (#18246)

Nick Hill committed over 1 year ago

[Misc][MacOS] fix bfloat16 error (#18249)

Reid committed over 1 year ago

[Model] Use autoweightloader for dbrx (#18251)

learner0810 committed over 1 year ago

[Fix] Fix typo in `resolve_hf_chat_template` (#18259)

fxmarty-amd committed over 1 year ago

use ceil_div in cutlass block scaling shape check (#17918)

Lain committed over 1 year ago

[Misc] Consolidate Audio tests into multimodal common generation tests (#18214)

Isotr0py committed over 1 year ago

[Misc] Add Ray Prometheus logger to V1 (#17925)

Seiji Eicher committed over 1 year ago

[PERF] Speed up Qwen2.5-VL model by speed up rotary position embedding (#17973)

Vadim Gimpelson committed over 1 year ago

[doc] fix multimodal example script (#18089)

David Xia committed over 1 year ago

[Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 (#17827)

Lucia Fang committed over 1 year ago

Throw better error for when running into k8s service discovery issue (#18209)

Will Eaton committed over 1 year ago

Allow users to pass arbitrary JSON keys from CLI (#18208)

Harry Mellor committed over 1 year ago

[Model] vLLM v1 supports Medusa (#17956)

Sky Lee committed over 1 year ago

[Bugfix][ROCm] Use `chunked_prefill_paged_decode` as fallback for V1 attention on ROCm (#18093)

kliuae committed over 1 year ago

[Bugfix] fix rotary embedding test for _get_padded_tensor_shape (#18229)

Lucas Wilkinson committed over 1 year ago

[Build] Allow shipping PTX on a per-file basis (#18155)

Lucas Wilkinson committed over 1 year ago

[Bugfix] Fix test_eagle test (#18223)

Lucia Fang committed over 1 year ago

Adding "AMD: Tensorizer Test" to amdproduction. (#18216)

Alexei-V-Ivanov-AMD committed over 1 year ago

[Misc] Avoid cuda graph log when sizes still match (#18202)

Nicolò Lucchesi committed over 1 year ago

[Bugfix] [ROCm]: Remove assertion logic when using AITER fused moe in unquantizedMethod to reenable LLama4 BF16 (#18205)

TJian committed over 1 year ago