Introspective Oversight: A Trained Observer Role Outperforms External Monitoring for Detecting Model Misbehavior
Official
Training a separate third-person observer role in a model yields mean AUROC 0.907 on five oversight evals, beating honesty training, transcript monitoring, and