Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
Mirrored from https://github.com/Camo67/composio.git
Synced Nov 21, 13:30 UTC
docs(sessions): explain experimental fast mode
Tridhatri Vallamkondu committed
Sep 9, 2026 at 13:53 UTC
ba49066bce127b6a29305e8b959c942ca402ec12
1 file changed
+45
docs/content/docs/configuring-sessions.mdx
+45
@@ -26,6 +26,51 @@ By default, a session has access to every toolkit in the Composio catalog. Your
26
27
You can also attach local custom tools and custom toolkits that run in-process alongside Composio tools. See [Custom tools and toolkits](/docs/extending-sessions/custom-tools-and-toolkits).
28
29
+## Fast mode (experimental)
30
+
31
+Fast mode reduces search latency by skipping the LLM reranker and plan search. To enable it, set `experimental.fast_mode` to `true` in the session creation request:
32
+
33
+```bash
34
+curl --request POST \
35
+ --url https://backend.composio.dev/api/v3/tool_router/session \
36
+ --header "x-api-key: $COMPOSIO_API_KEY" \
37
+ --header 'Content-Type: application/json' \
38
+ --data '{
39
+ "user_id": "user_123",
40
+ "experimental": {
41
+ "fast_mode": true
42
+ }
43
+ }'
44
+```
45
+
46
+Set `COMPOSIO_API_KEY` to your project API key before running this request. The flag applies to searches in that session, including `COMPOSIO_SEARCH_TOOLS` and the session search API. Omit it when creating a session to use the default search behavior.
47
+
48
+<Callout type="warn" title="Experimental">
49
+Fast mode returns embedding and keyword search results without LLM reranking. It also omits plan-derived guidance, including `recommended_plan_steps`, `known_pitfalls`, and `reference_workbench_snippets`. This can reduce retrieval quality, especially for requests that need multiple tools or steps. Evaluate it against your own queries before enabling it. Experimental behavior may change.
50
+</Callout>
51
+
52
+### Enable fast mode on an existing session
53
+
54
+You can also update a session created through the API or an SDK. Replace `SESSION_ID` with that session's ID and use a project API key from the same project:
55
+
56
+```bash
57
+curl --request PATCH \
58
+ --url "https://backend.composio.dev/api/v3/tool_router/session/$SESSION_ID" \
59
+ --header "x-api-key: $COMPOSIO_API_KEY" \
60
+ --header 'Content-Type: application/json' \
61
+ --data '{
62
+ "experimental": {
63
+ "fast_mode": true
64
+ }
65
+ }'
66
+```
67
+
68
+To turn fast mode off, send the same PATCH request with `"fast_mode": false`. Omitting the field from a PATCH request leaves its current value unchanged.
69
+
70
+<Callout type="info">
71
+The high-level TypeScript `composio.create()` and Python `composio.sessions.create()` helpers don't currently forward `fast_mode`. Use the API requests above to configure it, even if you use an SDK for the rest of your session workflow.
72
+</Callout>
73
+
74
## Enabling toolkits
75
76
To limit a session to specific toolkits, pass an array of toolkit slugs. The agent can only discover and use tools from these toolkits.