DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agents

· Editorial Team estimated
long-horizon-manipulation self-evolution vla task-and-motion-planning failure-attribution agent-framework

Pretrained robot policies provide useful action priors, but long-horizon manipulation still requires coordination between semantic reasoning and physical execution. The two operate at different timescales — semantic reasoning is coarse, physical interaction fine — and episode-level failures give only vague feedback that cannot answer which part of the system should be revised. DynaHarness proposes a dynamic physical harness that couples semantic reasoning with physical governance through a shared execution contract and turns failure evidence into validated capability revisions. A slow brain proposes capabilities and symbolic arguments, while a fast brain grounds and monitors commands, refuses unresolved actions, substitutes capabilities and requests replans when needed. The physical execution contract bounds each accepted command and records execution evidence across analytic skills, recovery skills and the frozen VLA. Failure attribution localizes faults within these records and directs targeted revisions of reusable capabilities or execution mechanisms, after which paired regression checks govern admission and rejection, closing the self-evolution loop. On LIBERO-Pro, DynaHarness reaches 75.2% on 800 newly sampled initial states versus 17.5% for the frozen policy; with the same capability library, full dynamic execution reaches 74.0% versus 63.9% under nominal one-step replanning.

Paper · arXiv:2609.40306

A frozen VLA policy succeeds on fewer than one in five long-horizon attempts. The real problem is rarely that the model is too weak — it is that nobody can say whether this failure calls for changing the policy, a skill, or the way execution is scheduled.

Background

Pretrained policies, VLA models in particular, offer strong action priors, but most emit a fixed-length chunk of motion and lack any explicit coordination of where the task currently stands or what should happen next. Long-horizon manipulation therefore exposes a seam: semantic reasoning (do this, then that) and physical execution (how this joint should move right now) live on different timescales. Worse, the feedback is usually episode-level — success or failure — and cannot identify which component is responsible. Without that attribution, any self-improvement is little more than guesswork.

Core Innovation

DynaHarness attacks this by giving the system an explicit physical governance layer. A slow brain proposes capabilities and symbolic arguments at the semantic level, while a fast brain grounds and monitors the resulting commands, refuses actions that have not been resolved, substitutes another capability when necessary, or requests a replan. The two are joined by a shared execution contract that both bounds every accepted command and records execution evidence across analytic skills, recovery skills and the frozen VLA.

The crucial part comes next. Failure attribution localizes where in these records a fault occurred, which directs targeted revision of a reusable capability or of an execution mechanism rather than an undifferentiated fine-tuning of the whole model. Once revised, paired regression checks decide whether the change is admitted or rejected, and only changes that pass are kept — this step closes and stabilizes the self-evolution loop. The system therefore improves by governing the capabilities it already has, not by swapping in a stronger backbone.

Results

  • On 800 newly sampled initial states in LIBERO-Pro, DynaHarness reaches 75.2% success versus 17.5% for the frozen policy.
  • With the same capability library, full dynamic execution reaches 74.0% against 63.9% for nominal one-step replanning, isolating a genuine gain from dynamic governance.
  • Failure attribution localizes faults to specific components, letting revisions land on reusable capabilities or execution mechanisms.
  • The method builds on a pretrained VLA plus a set of analytic and recovery skills, keeping changes in the governance layer rather than retraining the policy.

Limitations

The evaluation centers on the LIBERO-Pro simulation benchmark, and the abstract reports no physical-robot results, so how much of the governance gain survives limited world-model fidelity remains unknown. The execution contract bounds acceptable commands, but how those bounds are constructed — and whether they over-constrain contact-rich behavior — is not spelled out. Failure attribution and capability revision depend on the fast brain judging execution evidence reliably; should that attribution err, paired regression checks can guarantee the absence of regressions but not the correctness of the direction. The evaluation is success-rate-centric, with no quantified compute cost, revision counts or failure cases.

Industry Implications

For engineering teams, DynaHarness matters less for any single number than for decomposing long-horizon manipulation into an auditable structure: semantic proposals, physical governance, execution contract, failure attribution, regression gating. That layering makes system behavior traceable, localizable and reversible — exactly the properties that matter most and are hardest to satisfy in industrial deployment. It also points to a pragmatic upgrade path: when the backbone is already frozen and retraining is off the table for the near term, investing in the governance layer and in recording execution evidence may pay off faster than more data or a larger model.