Human-in-the-loop
HITL and the Pre-Mortem: Why the Reviewer Should Imagine the Failure Before Approving the Action
HITL and the Pre-Mortem: Why the Reviewer Should Imagine the Failure Before Approving the Action
Every HITL review is a forecast — the reviewer predicts the action's outcome. Most reviewers forecast by asking "will this work?" A small minority ask the inverse: "how will this fail?" That minority is right more often than the majority. The pre-mortem — imagining the failure before approving the action — is the cheapest, most effective single intervention HITL systems can adopt. Here is why, how to design for it, and what it changes.