An answer is not an action
A model generates an output from the input available to it. A chat interface carries a conversation; an agent harness can combine that model with context and tools in an action-and-check loop. A fluent explanation alone proves neither that a file changed nor that a test ran.
Before you start
Use a fictional static website called Cedar Studio. Its contact form has a name, an email address, and a message. No real customer records or working delivery service are needed. Keep a plain-text scratchpad for a requirement and an observation.
Example: “make the contact form better”
That request hides several different jobs. A chatbot can suggest clearer labels. An agent with file access might edit markup. A browser tool can inspect the result. A delivery service would send the message, which is a separate external action requiring explicit scope.
- Suggestion: “Add a visible email label.” Inspect the suggested wording, not a claimed file edit.
- Action: change contact.html only. Check the actual diff to see whether the label points at the input.
- Evidence: tab to the email field in a browser and confirm its accessible name. A screenshot alone cannot establish keyboard behavior.
Work through the task
- Write one observable problem: “The email box has only a placeholder, which disappears while typing.”
- Ask for a read-only explanation of the current markup and the smallest proposed correction.
- Classify each proposed step as advice, file change, command, or external action. Approve only the category you intend.
- After a permitted edit, inspect the file and repeat the original observation. Keep the before/after evidence together.
What a useful result looks like
A useful completion report names the file changed, the behavior checked, and what remains untested. “The form is improved” is too broad. “Email has a persistent label; delivery was not tested” is bounded and reviewable.
When to stop or change direction
Stop if a text-only answer claims to have deployed the site, if a worker requests live credentials for this markup exercise, or if the proposed change expands into a new backend. Ask for the missing evidence or a smaller task.
Verify before continuing
- Can you point to an artifact rather than a promise?
- Does the test examine the user-visible problem, not merely whether text was generated?
- Have you kept sending a real message outside this local exercise?
QUESTIONS THIS ANSWERS
Questions this answers
- What is the difference between an AI model and an agent?
- How do I know whether an AI actually changed a file?
Found something wrong? Report an error or read the corrections policy.
1 SOURCESEvidence ledger
Sources
- 01How Claude Code works ↗
Anthropic · accessed 4 Sept 2026