[BugFix] Illegal memory access for MoE On H20 (#13693)

Zhonghua Deng committed over 1 year ago

Expert Parallelism (EP) Support for DeepSeek V2 (#12583)

Jongseok Park committed over 1 year ago

[CI/Build] add python-json-logger to requirements-common (#12842)

Roger Meier committed over 1 year ago

[Bugfix] fix(logging): add missing opening square bracket (#13011)

Roger Meier committed over 1 year ago

[model][refactor] remove cuda hard code in models and layers (#13658)

Mengqing Cao committed over 1 year ago

[V1][Core] Fix memory issue with logits & sampling (#13721)

Roger Wang committed over 1 year ago

[ci] Add logic to change model to S3 path only when S3 CI env var is on (#13727)

Kevin H. Luu committed over 1 year ago

Fix some issues with benchmark data output (#13641)

Huy Do committed over 1 year ago

[V1][BugFix] Fix engine core client shutdown hangs (#13298)

Nick Hill committed over 1 year ago

[v1] torchrun compatibility (#13642)

youkaichao committed over 1 year ago

[Misc] Deprecate `--dataset` from `benchmark_serving.py` (#13708)

Roger Wang committed over 1 year ago

[Core][Distributed] Use IPC (domain socket) ZMQ socket for local comms (#13688)

Nick Hill committed over 1 year ago

[LMM] Implement merged multimodal processor for whisper (#13278)

Isotr0py committed over 1 year ago

[Quant] BaiChuan SupportsQuant (#13710)

Kyle Sayers committed over 1 year ago

[ci] Use env var to control whether to use S3 bucket in CI (#13634)

Kevin H. Luu committed over 1 year ago

[BugFix] Minor: logger import in attention backend (#13706)

Andy Lo committed over 1 year ago

[CI/Build] Fix pre-commit errors from #13571 (#13709)

Roger Wang committed over 1 year ago

[CI/Build] fix uv caching in Dockerfile (#13611)

Daniele committed over 1 year ago

[XPU]fix setuptools version for xpu (#13548)

Yan Ma committed over 1 year ago

[Bugfix] Fix boolean conversion for OpenVINO env variable (#13615)

Helena Kloosterman committed over 1 year ago