Monitoring Web Agents Without Internal Signals

Sitong Pan and five co-authors · arXiv preprint 2 Sep

Macro and micro observable trajectory features predict whether a web-agent execution is heading towards failure when token logits are unavailable. Key-step supervision avoids labelling valid early prefixes as failures. Practical value: model-agnostic early intervention. Limits: benchmark transfer may not represent production sites. Paper