Bind Claude Code test results to the code they actually tested
Claude Code can report passing tests from different repository states. Add a run fingerprint so each result names the exact code, dependencies, tools, and policy it tested.
Topic archive
112 essays tagged Claude Code. Practical notes on what happens after the demo: prompts, tools, review packets, evals, rollback, and production ownership.
Claude Code can report passing tests from different repository states. Add a run fingerprint so each result names the exact code, dependencies, tools, and policy it tested.
An MCP tool can return success after changing the wrong target or using the wrong authority. Make Claude Code prove the external effect before it reports completion.
Claude Code can accidentally include a developer’s unfinished edit or another agent’s output in its patch. Record the baseline, attribute every hunk, and block commits when ownership is unclear.
A Claude Code plan can become stale after another commit changes its assumptions. Bind approval to repository state and force a replan when the relevant boundary moves.
A timed-out MCP tool call may have completed after the connection closed. Verify the external result before Claude Code retries a write.
An approved AI agent can still produce a dangerous command, query, or tool argument. Validate generated output at the receiving boundary before another system acts on it.
A Claude Code branch can change after tests pass and approval is given. Bind test results, review evidence, and release approval to the exact commit that produced them.
Persistent memory can make an AI agent faster, but stale facts, copied instructions, and missing ownership can quietly steer later runs. Store provenance, scope, review dates, and deletion rules with every memory.
An AI agent can return the right answer after using the wrong identity, reading the wrong data, or calling a tool it never needed. Production evals should inspect the path as well as the result.
A Claude Code diff shows the final change, but it leaves out the starting state, failed commands, MCP results, skipped tests, and plan changes. Capture a compact replay record before the run disappears.