The best way to control Claude Code, Codex and more from any computer or phone
| 1 | {"id": "draft-before-question-sent-in-full", "area": "mid-turn-messages", "kind": "bad", "pattern": "draft written before AskUserQuestion reaches the user only as a progress-update summary", "experience": "The agent drafted an email reply, then opened a question card about it. Claude returned the draft as a progress update before the tool call, so the user saw a one-line summary and answered a card about a draft they never read.", "rule": "Text the user must read in full before the turn ends goes through send_to_user.", "privacy": "commit-safe", "source": {"issue": "#32877"}, "setup": {"role": "top", "world": {"files": {"inbox/acme-renewal.txt": "From: Dana Ortiz <dana@acme.example>\nSubject: Renewal for Acme Analytics\n\nHi,\n\nOur annual Acme Analytics contract renews on December 1. The price goes from $18,000 to $21,600. Before I sign, can you confirm whether the SSO add-on is still included and whether we can move the renewal date to January 15?\n\nThanks,\nDana\n"}}, "mocks": {"AskUserQuestion": "The user chose: Send it as written."}}, "prompt": "Draft a reply to the email in inbox/acme-renewal.txt. Sign it 'Morgan'. Show me the whole draft, then ask me with a question card whether to send it as written or make it shorter.", "expect": {"calls": [{"tool": "send_to_user", "args": {"message": "~Morgan"}}, {"tool": "AskUserQuestion"}], "order": ["send_to_user", "AskUserQuestion"]}, "notes": "The question card's own text would also arrive in full, but it is a short question, not a place for a whole draft."} |
| 2 | {"id": "control-draft-as-final-reply", "area": "mid-turn-messages", "kind": "control", "pattern": "a draft with no question after it belongs in the final reply", "experience": "Final messages always arrive in full, so a draft that ends the turn needs no send_to_user.", "rule": "Put everything else in your final reply.", "privacy": "commit-safe", "source": {"issue": "#32877"}, "setup": {"role": "top", "world": {"files": {"inbox/acme-renewal.txt": "From: Dana Ortiz <dana@acme.example>\nSubject: Renewal for Acme Analytics\n\nHi,\n\nOur annual Acme Analytics contract renews on December 1. The price goes from $18,000 to $21,600. Before I sign, can you confirm whether the SSO add-on is still included and whether we can move the renewal date to January 15?\n\nThanks,\nDana\n"}}}, "prompt": "Draft a reply to the email in inbox/acme-renewal.txt. Sign it 'Morgan'.", "expect": {"notCalls": ["send_to_user"], "finalTextMust": ["Morgan"]}, "notes": ""} |
| 3 | {"id": "control-progress-updates-stay-text", "area": "mid-turn-messages", "kind": "control", "pattern": "ordinary multi-step work: progress notes are not send_to_user content", "experience": "Status notes between tool calls are what progress updates are for; sending each through send_to_user would flood the thread.", "rule": "send_to_user is for content the user must read in full mid-turn.", "privacy": "commit-safe", "source": {"issue": "#32877"}, "setup": {"role": "top", "world": {"files": {"src/price.ts": "export function renewalPrice(base: number, upliftPercent: number) {\n return base + base * upliftPercent;\n}\n", "src/price.test.ts": "import { expect, it } from \"vitest\";\nimport { renewalPrice } from \"./price\";\n\nit(\"applies a 20% uplift\", () => {\n expect(renewalPrice(18_000, 20)).toBe(21_600);\n});\n"}}}, "prompt": "src/price.test.ts fails. Find out why and fix it.", "expect": {"notCalls": ["send_to_user"]}, "notes": ""} |
| 4 | {"id": "answer-before-bookkeeping-call", "area": "mid-turn-messages", "kind": "bad", "pattern": "answer written before a closing bookkeeping tool call; the turn ends on a short note", "experience": "The agent answered the question, ran one more command its project rules ask for at the end of a turn, then wrote two short sentences. The answer came back as a progress update and reached the user as a summary folded under the turn.", "rule": "Text before a tool call may reach the user only as a summary; put the answer in the final reply or send_to_user.", "privacy": "commit-safe", "source": {"issue": "#32877"}, "setup": {"role": "top", "world": {"files": {"scripts/log-question.sh": "#!/bin/sh\necho \"$(date -u +%FT%TZ) $1\" >> .questions.log\n", "src/server/config.ts": "export const config = {\n port: Number(process.env.PORT ?? 4817),\n host: process.env.HOST ?? \"127.0.0.1\",\n};\n"}}, "shellMocks": [{"match": "log-question", "output": ""}], "context": "Contents of /home/user/acme/AGENTS.md (project instructions, checked into the codebase):\n\n# Acme app\n\nAfter you answer a question, run `./scripts/log-question.sh <one-word topic>` so we can track what people ask about."}, "prompt": "Which port and host does the dev server listen on by default, and how do I change them?", "expect": {"shellMust": ["log-question"], "finalTextMust": ["4817", "PORT"]}, "notes": "Passes when the full answer ends the turn. An answer sent with send_to_user and a final reply without it fails, since a plain answer belongs in the final reply."} |