PEARS: Cheap Real-World Adaptation for Tactile Manipulation

· Editorial Team estimated
tactile-manipulation reinforcement-learning sample-efficiency sim-to-real diffusion-policy vision-language-model

Pretrained robot policies degrade under out-of-distribution conditions, and reinforcement-learning post-training can repair them — but in manipulation, where every trial is slow, costly, or destructive, the interaction budget is the binding constraint. PEARS is a physics-prior-guided hybrid RL framework for sample-efficient online adaptation with tactile feedback. Its physics-guided force reasoning module uses priors encoded in a vision-language model to diagnose failures from the visual outcome and tactile history, then updates task-appropriate contact-force bounds that a high-frequency hybrid force-position controller enforces. In parallel, tactile-conditioned diffusion steering adjusts the latent noise of a frozen flow-matching policy to fix free-space motion and contact timing without retraining the base model. In simulation it lifts success rates by 12.4-37.4 percentage points over the strongest per-task baselines and cuts the episodes needed to reach a success threshold by up to 53.2%; on real robots it reaches 95% on Whiteboard Erasing and 90% on Pipette Liquid Aspiration.

Paper · arXiv:2610.08784

Every robotics team that has tried to fix a deployed policy with real-world trials knows the true cost is not compute but failures — a dropped part, a spilled sample, a scratched surface. PEARS is a well-structured attempt to make those failures buy as much improvement as possible.

Background

Policies pretrained from demonstrations are only as good as the conditions they were trained on, and out-of-distribution situations encountered in deployment cause substantial performance degradation. The natural fix is post-training through real-world interaction, but reinforcement-learning post-training typically requires a large number of environment interactions. In manipulation this burden is especially heavy: each trial may be slow, costly, or destructive, so the interaction budget — not the algorithm’s asymptotic performance — is what determines whether real-world adaptation is practical at all. The setting PEARS targets is therefore not “how do we adapt” but “how do we adapt with far fewer costly episodes,” and it brings tactile feedback in as the key new signal.

Core Innovation

PEARS is a physics-prior-guided hybrid RL framework with two cooperating components. The first is a physics-guided force reasoning (PFR) module: after each episode it uses physical priors encoded in a vision-language model to diagnose the failure from the visual outcome and the tactile interaction history, then updates task-appropriate contact-force bounds. A high-frequency hybrid force-position controller enforces those bounds during contact, turning the diagnosis into an immediate, physically grounded correction. The second component is tactile-conditioned diffusion steering reinforcement learning, which adjusts the latent noise of a frozen flow-matching policy to correct errors in free-space motion and contact timing. Crucially, this steers the policy without updating the base model, so adaptation is cheap and the expensive pretrained weights stay intact. The two halves are complementary: force bounds govern the contact regime, while diffusion steering governs motion and timing.

Results

  • In simulation, PEARS improves success rates by 12.4 to 37.4 percentage points over the strongest per-task baselines.
  • It reduces the number of interaction episodes required to reach a given success threshold by up to 53.2% relative to the fastest baseline.
  • On real robots, it achieves 95% success on Whiteboard Erasing and 90% on Pipette Liquid Aspiration.
  • The method requires tactile feedback but does not update the base policy network.

Limitations

PEARS assumes tactile sensing is available, which adds hardware and integration cost that not every platform carries. The force-reasoning module depends on a vision-language model to diagnose failures, and that diagnosis can be brittle or wrong in ways the abstract does not characterize; a misdiagnosis corrupts the force bounds that the controller then enforces. The real-world validation covers only two tasks — whiteboard erasing and pipette aspiration — which are useful but relatively forgiving, and the abstract does not report performance on unseen objects or how the method fails. The episode reduction is stated relative to “the fastest baseline” rather than absolutely, and the reported gains are against per-task baselines, which makes it harder to judge robustness across task families.

Industry Implications

Contact-rich manipulation — assembly, lab automation, cleaning, inspection — is exactly the domain where policies most need real-world refinement and where real-world trials are most expensive. PEARS attacks the cost of that refinement directly, and its most transferable property is that it adapts a frozen policy: a team can improve a deployed model by steering its latent noise and adjusting force bounds, without retraining and without a full redeployment cycle. That is a meaningful operational difference for any fleet that has to stay in service while it improves. The flip side is a real integration requirement — tactile sensing must be present, and a VLM must be trusted to diagnose contact failures — so adopters should weigh the sensing investment against the interaction savings, and validate the failure-diagnosis step before relying on it in the loop.