LoopWAM: Turning Deployment Failures and Successes into a Better Robot Policy

Every deployed robot generates a stream of successes, mediocre attempts and outright failures. This paper treats all three as training signal instead of discarding the bad ones.

Background

Scaling expert demonstrations alone does not let generalist robot policies improve from deployment. Real-world rollouts are a mix: successes, suboptimal behavior, and failures. Imitating every recorded action can reinforce poor behavior, while filtering out the failures throws away evidence of physical interactions and their consequences, which is precisely the knowledge a policy needs to avoid repeating them. The paper asks how to learn from the full quality spectrum rather than a curated slice of it.

Core Innovation

LoopWAM is a closed-loop world-action model that learns directly from this full spectrum, using rollouts from both itself and other deployed policies. Source-dependent noise sampling unifies behavior learning and action-conditioned world modeling; quality steering and quality-weighted supervision keep full video supervision across qualities while regulating how much the policy imitates the actions. Video and action tokens interact throughout parallel denoising, so the learned physical consequences inform action generation directly rather than through a separate stage. The result is a policy that can be improved by the ordinary traffic of deployment.

Results

• On RoboChallenge Table30-V2, three deployment-and-training rounds raise success from 23.67% to 43.33%, a 19.7-percentage-point gain, with a final score of 56.80.
• It achieves 94.5% average success on RoboTwin 2.0 and 49.5% overall success on RoboCasa365 without additional embodied pretraining, the best overall results among the compared methods across all three benchmarks.
• On shirt folding, two rounds of deployment-driven improvement after single-task post-training raise success from 13.20% to 55.56%.
• The gains hold under both multi-task learning and single-task post-training.

Limitations

The headline mechanism is a deployment loop, which is expensive to run and hard to reproduce without an actual fleet in the field; the gains are bought with repeated rounds of real interaction. The absolute numbers, a 56.80 final score on the hardest benchmark and 49.5% on RoboCasa365, show how far the generalist problem still is from solved, even with the best result in the comparison. Superiority is stated “among the compared methods,” so it is relative to the authors’ baseline set. The method also presumes a quality label or quality signal to steer supervision, and the source of that signal is the quiet dependency the recipe rests on.

Industry Implications

The real claim is that a deployed fleet’s ordinary activity is training data. You do not have to wait for a curated expert dataset, and you do not have to throw failed episodes away; quality-weighted supervision and quality steering are the mechanisms that let an operator open the throttle on learning from messy production logs without teaching the policy its own bad habits. For fleet operators, that is the difference between a policy that decays in the field and one that sharpens with use, and it turns operating time into a compounding asset rather than a cost.