Quality and Verification
A spec without evidence is a document. A test without intent is decoration. Quality is what closes the gap between them.
This topic is about evidence. The spec states the target. The tests, checks, and review structure show whether the implementation actually hit it.
Prompt engineering works on the input. Quality and Verification examines the output against the recorded target. Intent Engineering needs both sides of that boundary.
Tests catch behavior regressions. Evals catch regressions in the agent setup. AC IDs hold traceability together when a spec gets edited. Checkpoints catch the stale document, the missing archive, and the PR that arrived without evidence. For teams that want it, .principles adds machine-readable structure checks on top.
None of these practices are new. What changes with coding agents is the rate of change and how quickly informal review starts missing things.
Chapters
- Tests as Evidence, Not Ritual: a test is evidence only if it fails when the implementation diverges from intent
- Test Strategy and Convention: the test taxonomy, the convention document the agent reads, scenario complexity tiers, and the AC registry
- Agent Evaluation and Regression: golden tests for the agent setup itself, A/B comparison of instruction-file changes
- AC IDs and Coverage: bracket-format IDs,
Test-type:field, dual@Tagtagging, the AC registry, positive and negative pairs - Keeping Documentation Up to Date: stable links from prose to code, drift signals, and a three-layer check structure for important documents
- Before, During, After: The Three Checkpoints: the foundation gate, the implementation gate, and the verification gate, and what each catches that the others cannot
- What the Scanners Miss: the failure modes standard tools do not see: pattern replication, deference to the user, and cleanup PRs that remove controls
- PR Taxonomy: docs, structural, behavioral. Three review styles, one class per PR
- .principles: Raising the Bar: principle-as-code as an optional complement to specs and tests