Two Claude Code eval cases are separated by a reset gate that verifies a clean sandbox before the second case starts

Claude Code passed the eval because the previous case cleaned up for it

A Claude Code eval can pass only because an earlier case left the sandbox in a helpful state. Give every case a fresh environment, a state fingerprint, and a reset receipt.

September 5, 2026 · 5 min · 951 words · Thomas De Vos
Read Claude Code passed the eval because the previous case cleaned up for it
A Claude Code test denominator records expected, discovered, selected, executed, skipped, and missing tests before a review can pass

Make Claude Code report the tests it did not run

A green test result says little when the agent selected the wrong suite or skipped the risky path. Add a test denominator to every Claude Code review packet.

August 18, 2026 · 5 min · 940 words · Thomas De Vos
Read Make Claude Code report the tests it did not run
Two passing Claude Code test commands point to different commit, working tree, and lockfile fingerprints, so the review marks one result stale and requests a rerun

Bind Claude Code test results to the code they actually tested

Claude Code can report passing tests from different repository states. Add a run fingerprint so each result names the exact code, dependencies, tools, and policy it tested.

August 5, 2026 · 5 min · 1065 words · Thomas De Vos
Read Bind Claude Code test results to the code they actually tested