main
md 25 lines 929 Bytes
Rendered Raw
1 ## multimodal vision tools
2
3 ### vision_load
4 load images into the model for visual reasoning
5 args: `paths` list of absolute image paths or tool-returned ephemeral image refs, optional `query` for focused inspection
6 rules:
7 - load all relevant images in one call when comparing screenshots or pages
8 - add `query` when the visual task is narrower than the user's request or derived during the work
9 - use when the task depends on screenshots, diagrams, scanned documents, charts, or photos
10 - only bitmaps are supported; convert other formats first if needed
11 - the tool result includes loaded/skipped image totals and the corresponding path lists
12 example:
13 ```json
14 {
15 "thoughts": [
16 "I need to compare the screenshots."
17 ],
18 "headline": "Comparing screenshots",
19 "tool_name": "vision_load",
20 "tool_args": {
21 "paths": ["/path/to/before.png", "/path/to/after.png"],
22 "query": "Compare the error-banner alignment."
23 }
24 }
25 ```