@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 740f0647b1
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

Reinstate existing torch script (#24729)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Harry Mellor committed Sep 15, 2025 at 17:43 UTC 740f0647b1d1cff7d2def13179b92e0452c9cb46
1 file changed +18 -2
use_existing_torch.py
+18 -2
@@ -1,5 +1,21 @@
1 # SPDX-License-Identifier: Apache-2.0
2 # SPDX-FileCopyrightText: Copyright contributors to the vLLM project
3
4 -print("vLLM is now using 'uv' to disable build isolation for 'torch'.")
5 -print("Please instead install vLLM with 'uv pip install -e .' (must use 'uv')")
4 +import glob
5 +
6 +requires_files = glob.glob('requirements/*.txt')
7 +requires_files += ["pyproject.toml"]
8 +for file in requires_files:
9 + print(f">>> cleaning {file}")
10 + with open(file) as f:
11 + lines = f.readlines()
12 + if "torch" in "".join(lines).lower():
13 + print("removed:")
14 + with open(file, 'w') as f:
15 + for line in lines:
16 + if 'torch' not in line.lower():
17 + f.write(line)
18 + else:
19 + print(line.strip())
20 + print(f"<<< done cleaning {file}")
21 + print()
\ No newline at end of file