A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 17, 06:45 UTC
Add py.typed so consumers of vLLM can get type checking (#1509)
* Add py.typed so consumers of vLLM can get type checking * Update py.typed --------- Co-authored-by: aarnphm <29749331+aarnphm@users.noreply.github.com> Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
Jared Roesch committed
Oct 30, 2023 at 14:50 UTC
79a30912b8d6e9867e56a579cf93d56bf30c955e
2 files changed
+3
setup.py
+1
@@ -278,4 +278,5 @@ setuptools.setup(
278
install_requires=get_requirements(),
279
ext_modules=ext_modules,
280
cmdclass={"build_ext": BuildExtension},
281
+ package_data={"vllm": ["py.typed"]},
282
)
vllm/py.typed
new
+2
@@ -0,0 +1,2 @@
1
+# Marker file for PEP 561.
2
+# The vllm package uses inline types.