main
py 13 lines 693 Bytes
Raw
1 # SPDX-License-Identifier: Apache-2.0
2 # SPDX-FileCopyrightText: Copyright contributors to the vLLM project
3 """NVIDIA-only (cutedsl/cutlass) kernels for DeepSeek V4.
4
5 These modules import ``cutlass``/``cutedsl`` at module top level, so they must
6 not be imported on non-CUDA platforms. Callers should gate on
7 ``vllm.utils.import_utils.has_cutedsl()`` before importing from here.
8
9 This ``__init__`` deliberately imports nothing: re-exporting the cutedsl
10 modules here would eagerly ``import cutlass`` (initializing the CUDA driver) for
11 anyone who imports ``vllm.models.deepseek_v4``, breaking forked subprocesses.
12 Import the leaf modules directly under a ``has_cutedsl()``/``is_cuda()`` gate.
13 """