P²: Reading a VLA's Own Activations to Catch It Going Off-Course

Vision-language-action models can carry out varied manipulation tasks straight from images and natural language, but they make mistakes, and they make them unpredictably. Removing the human supervisor requires a runtime monitor that notices when the policy has gone off-course and triggers takeover or replanning.

The prevailing approach bolts on a vision-language model to judge the policy’s behaviour. It works, at a real cost: an extra foundation-model inference path, extra system complexity, and a monitor whose judgement has no internal relationship to what the policy is actually representing. P² asks a sharper question: do the VLA’s own internal activations already contain what a monitor needs?

Core innovation

The answer is yes, and the machinery required is minimal.

P² trains linear probes on the policy’s activations from demonstration data to estimate task progress. At execution time, if observed progress persistently deviates from what the probes predict, the episode is flagged. No external model, no frame-level progress annotations, and no failure data — the supervision comes entirely from successful demonstrations.

That last point deserves emphasis. Much prior work learns “what failure looks like” from failed trajectories, which are exactly the data that is hardest and most expensive to obtain in real deployment. P² retreats to the most commonly available starting point, successful demonstrations alone. The engineering implication is concrete: any team that has already collected teleoperation data can train a monitor without collecting anything new.

Results

Evaluation used the open-source VLA π0.5 across simulated and real-world manipulation tasks:

• For task failure detection, P² is competitive with or outperforms VLM-based monitors.
• It also beats methods that require failure data for training.

In other words, a linear probe over internal signals reaches the discrimination quality of an external foundation model. For cost-sensitive deployments, that substitution is a strong trade.

Limitations

• The abstract reports only a qualitative “competitive or better,” with no detection metrics — no AUROC, false-positive rate, or lead time before failure — so practical reliability is hard to judge.
• Probes are trained on demonstrations, which implicitly assumes execution stays close to the demonstration distribution. With novel objects, lighting or layouts the probes themselves may drift, precisely when a monitor matters most; out-of-distribution behaviour is not evaluated.
• Evaluation covers one model (π0.5) and manipulation tasks. Transfer to other models and embodiments — humanoid whole-body control, mobile manipulation — is untested.
• The monitor detects deviation; the abstract does not say whether it can classify failure types or suggest recovery.

Industry implications

For teams moving VLA policies toward unattended operation, this paper supplies a very cheap baseline: look inside the policy before adding another model on top.

The underlying claim is that VLA activations already encode state information such as task progress, it simply is not read out explicitly. If that holds across more models, runtime monitoring shifts from “add a foundation model” to “attach a few probes” — negligible added latency, and no second failure mode introduced. On compute-constrained onboard hardware, that difference decides whether monitoring ships at all.

It also suggests a broader design principle: monitorability can be a property of the policy rather than a capability bolted onto it. If later work makes “progress is linearly readable” an explicit training objective, monitor accuracy could improve without costing policy performance.

What to watch is out-of-distribution behaviour. Production floors and homes do not stay inside the demonstration distribution, and the false-alarm and miss rates in unfamiliar scenes determine whether such a monitor reduces human intervention or merely converts it into alarm handling.