@tduncan / Nvidia-Optimization-Stack-VLLM Mirror · read-only / commits / 243137143c
Fork 0

A high-throughput and memory-efficient inference and serving engine for LLMs

Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git

Synced Nov 15, 23:30 UTC

[Doc] Add link to tool_choice tracking issue in tool_calling.md (#13003)

Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>

Yuan Tang committed Feb 10, 2025 at 01:09 UTC 243137143c81f738db17cfcd93d991f6dd842e27
1 file changed +1 -1
docs/source/features/tool_calling.md
+1 -1
@@ -1,6 +1,6 @@
1 # Tool Calling
2
3 -vLLM currently supports named function calling, as well as the `auto` and `none` options for the `tool_choice` field in the chat completion API. The `tool_choice` option `required` is **not yet supported** but on the roadmap.
3 +vLLM currently supports named function calling, as well as the `auto` and `none` options for the `tool_choice` field in the chat completion API. The `tool_choice` option `required` is **not yet supported** but [on the roadmap](gh-issue:13002).
4
5 ## Quickstart
6