A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 16, 15:45 UTC
[MISC] Fix invalid escape sequence '\' (#8830)
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Peter Pan committed
Sep 27, 2024 at 16:13 UTC
0e088750af2e8035c07d356b56c03393cfb56004
1 file changed
+2
-2
benchmarks/benchmark_serving.py
+2
-2
@@ -1,4 +1,4 @@
1
-"""Benchmark online serving throughput.
1
+r"""Benchmark online serving throughput.
2
3
On the server side, run one of the following commands:
4
vLLM OpenAI API server
@@ -963,4 +963,4 @@ if __name__ == "__main__":
963
)
964
965
args = parser.parse_args()
966
- main(args)
\ No newline at end of file
966
+ main(args)