A high-throughput and memory-efficient inference and serving engine for LLMs
Mirrored from https://github.com/tduncan-lum/Nvidia-Optimization-Stack---VLLM.git
Synced Nov 4, 23:45 UTC
[Doc] Fix typos in token_embed pooling documentation (#40266)
Signed-off-by: YifanLi3 <lyfqlx3@gmail.com>
Lxx committed
Apr 19, 2026 at 19:27 UTC
d886c26d4d4fef7d079696beb4ece1cfb4b008a8
1 file changed
+2
-2
docs/models/pooling_models/token_embed.md
+2
-2
@@ -9,14 +9,14 @@
9
- Online APIs:
10
- Pooling API (`/pooling`)
11
12
-The difference between the (sequence) embedding task and the token embedding task is that (sequence) embedding outputs one embedding for each sequence, while token embedding outputs a embedding for each token.
12
+The difference between the (sequence) embedding task and the token embedding task is that (sequence) embedding outputs one embedding for each sequence, while token embedding outputs an embedding for each token.
13
14
Many embedding models support both (sequence) embedding and token embedding. For further details on (sequence) embedding, please refer to [this page](embed.md).
15
16
!!! note
17
18
Pooling multitask support is deprecated and will be removed in v0.20. When the default pooling task (embed) is not
19
- what you want, you need to manually specify it via via `PoolerConfig(task="token_embed")` offline or
19
+ what you want, you need to manually specify it via `PoolerConfig(task="token_embed")` offline or
20
`--pooler-config.task token_embed` online.
21
22
## Typical Use Cases