@devries-cameron20 / composio Mirror · read-only / commits / ba49066bc
Fork 0

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

Mirrored from https://github.com/Camo67/composio.git

Synced Nov 21, 13:30 UTC

docs(sessions): explain experimental fast mode

Tridhatri Vallamkondu committed Sep 9, 2026 at 13:53 UTC ba49066bce127b6a29305e8b959c942ca402ec12
1 file changed +45
docs/content/docs/configuring-sessions.mdx
+45
@@ -26,6 +26,51 @@ By default, a session has access to every toolkit in the Composio catalog. Your
26
27 You can also attach local custom tools and custom toolkits that run in-process alongside Composio tools. See [Custom tools and toolkits](/docs/extending-sessions/custom-tools-and-toolkits).
28
29 +## Fast mode (experimental)
30 +
31 +Fast mode reduces search latency by skipping the LLM reranker and plan search. To enable it, set `experimental.fast_mode` to `true` in the session creation request:
32 +
33 +```bash
34 +curl --request POST \
35 + --url https://backend.composio.dev/api/v3/tool_router/session \
36 + --header "x-api-key: $COMPOSIO_API_KEY" \
37 + --header 'Content-Type: application/json' \
38 + --data '{
39 + "user_id": "user_123",
40 + "experimental": {
41 + "fast_mode": true
42 + }
43 + }'
44 +```
45 +
46 +Set `COMPOSIO_API_KEY` to your project API key before running this request. The flag applies to searches in that session, including `COMPOSIO_SEARCH_TOOLS` and the session search API. Omit it when creating a session to use the default search behavior.
47 +
48 +<Callout type="warn" title="Experimental">
49 +Fast mode returns embedding and keyword search results without LLM reranking. It also omits plan-derived guidance, including `recommended_plan_steps`, `known_pitfalls`, and `reference_workbench_snippets`. This can reduce retrieval quality, especially for requests that need multiple tools or steps. Evaluate it against your own queries before enabling it. Experimental behavior may change.
50 +</Callout>
51 +
52 +### Enable fast mode on an existing session
53 +
54 +You can also update a session created through the API or an SDK. Replace `SESSION_ID` with that session's ID and use a project API key from the same project:
55 +
56 +```bash
57 +curl --request PATCH \
58 + --url "https://backend.composio.dev/api/v3/tool_router/session/$SESSION_ID" \
59 + --header "x-api-key: $COMPOSIO_API_KEY" \
60 + --header 'Content-Type: application/json' \
61 + --data '{
62 + "experimental": {
63 + "fast_mode": true
64 + }
65 + }'
66 +```
67 +
68 +To turn fast mode off, send the same PATCH request with `"fast_mode": false`. Omitting the field from a PATCH request leaves its current value unchanged.
69 +
70 +<Callout type="info">
71 +The high-level TypeScript `composio.create()` and Python `composio.sessions.create()` helpers don't currently forward `fast_mode`. Use the API requests above to configure it, even if you use an SDK for the rest of your session workflow.
72 +</Callout>
73 +
74 ## Enabling toolkits
75
76 To limit a session to specific toolkits, pass an array of toolkit slugs. The agent can only discover and use tools from these toolkits.