@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 0e088750af
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 16, 15:45 UTC

[MISC] Fix invalid escape sequence '\' (#8830)

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>

Peter Pan committed Sep 27, 2024 at 16:13 UTC 0e088750af2e8035c07d356b56c03393cfb56004
1 file changed +2 -2
benchmarks/benchmark_serving.py
+2 -2
@@ -1,4 +1,4 @@
1 -"""Benchmark online serving throughput.
1 +r"""Benchmark online serving throughput.
2
3 On the server side, run one of the following commands:
4 vLLM OpenAI API server
@@ -963,4 +963,4 @@ if __name__ == "__main__":
963 )
964
965 args = parser.parse_args()
966 - main(args)
\ No newline at end of file
966 + main(args)