Fix FBGEMM integration (#18002)

Michael Goin committed over 1 year ago

[V1][Spec Decode] Eagle unit tests (#17350)

wwl2755 committed over 1 year ago

[CI] Make JSON output tests less likely to fail (#17859)

Russell Bryant committed over 1 year ago

Enable standard language model for torhc nightly (#18004)

Yang Wang committed over 1 year ago

[Chore] Remove unused method (#18024)

Robert Shaw committed over 1 year ago

[v1][KVCacheManager] Change prefix caching metric from counting blocks to counting tokens (#18003)

Chen Zhang committed over 1 year ago

Enabling "Weight Loading Multiple GPU Test - Large Models" (#18020)

Alexei-V-Ivanov-AMD committed over 1 year ago

[Core] Use platform-agnostic device control for DP engine core (#17245)

Jade Zheng committed over 1 year ago

[CI/Build] Fix TPU V1 Test mixed use of & and && across tests (#17968)

Carol Zheng committed over 1 year ago

Construct `KVTransferConfig` properly from Python instead of using JSON blobs without CLI (#17994)

Harry Mellor committed over 1 year ago

[Lora][Frontend]Add default local directory LoRA resolver plugin. (#16855)

Jonathan Berkhahn committed over 1 year ago

[P/D] NIXL Integration (#17751)

Robert Shaw committed over 1 year ago

Initialize the delta tool call fields explicitly (#17340)

Maximilien de Bayser committed over 1 year ago

[Misc] Improve modelscope import error (#17983)

Jee Jee Li committed over 1 year ago

Correcting testcases in builkite job for IBM Power (#17675)

Aaruni Aggarwal committed over 1 year ago

[Feature] Support DeepSeekV3 Function Call (#17784)

Xu Wenqing committed over 1 year ago

[Fix] Benchmark `"EngineClient" has no attribute "model_config"` (#17976)

Brayden Zhong committed over 1 year ago

[Bugfix][TPU] Use np array when updating cache slot_mapping (#17971)

Siyuan Liu committed over 1 year ago

[Bugfix] Fix pydantic.errors.PydanticUserError (#17962)

Li Wang committed over 1 year ago

[bugfix] fix the wrong parser (#17958)

Reid committed over 1 year ago