@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 79a30912b8
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 17, 06:45 UTC

Add py.typed so consumers of vLLM can get type checking (#1509)

* Add py.typed so consumers of vLLM can get type checking * Update py.typed --------- Co-authored-by: aarnphm <29749331+aarnphm@users.noreply.github.com> Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

Jared Roesch committed Oct 30, 2023 at 14:50 UTC 79a30912b8d6e9867e56a579cf93d56bf30c955e
2 files changed +3
setup.py
+1
@@ -278,4 +278,5 @@ setuptools.setup(
278 install_requires=get_requirements(),
279 ext_modules=ext_modules,
280 cmdclass={"build_ext": BuildExtension},
281 + package_data={"vllm": ["py.typed"]},
282 )
vllm/py.typed new
+2
@@ -0,0 +1,2 @@
1 +# Marker file for PEP 561.
2 +# The vllm package uses inline types.