@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 2da02dd0d8
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 14, 05:30 UTC

[Fix] DeepSeek V3.1 tool parser error message (#23492)

Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>

ZiTian Zhao committed Aug 25, 2025 at 15:56 UTC 2da02dd0d8879ee5085e33979698468b3ea68c56
1 file changed +2 -2
vllm/entrypoints/openai/tool_parsers/deepseekv31_tool_parser.py
+2 -2
@@ -64,8 +64,8 @@ class DeepSeekV31ToolParser(ToolParser):
64 if (self.tool_calls_start_token_id is None
65 or self.tool_calls_end_token_id is None):
66 raise RuntimeError(
67 - "DeepSeek-V3 Tool parser could not locate tool call start/end "
68 - "tokens in the tokenizer!")
67 + "DeepSeek-V3.1 Tool parser could not locate tool call "
68 + "start/end tokens in the tokenizer!")
69
70 def extract_tool_calls(
71 self,