DirectWAM: De-Diffusing World-Action Models into Single-Step Control

Predicting the future sounds expensive. DirectWAM first works out which part of the future is actually making the decision, then keeps only that.

Background

World-action models (WAMs) have become a main line of attack for generalist embodied policies: the model predicts how the visual scene will evolve, then generates actions conditioned on that prediction. Compared with a VLA that maps observation straight to action, the explicit future-to-action cascade has a conceptual advantage — the policy is forced to model what its actions will cause, not merely to memorise an observation-to-action mapping.

The price is inference cost. These models are typically built on diffusion or flow-matching backbones, so generating a future takes many denoising iterations, followed by one or more sampling passes in the action head. That is tolerable in simulation and unacceptable on a robot that must close the loop at control rate. Existing accelerations mostly work on the sampler — fewer steps, better solvers — and rarely ask the prior question: how precise does the future in the cascade actually need to be?

Core Innovation

The paper diagnoses before it proposes, and that ordering is its most valuable feature.

First experiment: resample the video noise and see whether downstream actions move. They barely do. The stochastic diversity of the future is not what makes actions good.

Second experiment: naively truncate both the video and action streams to a single step. Success drops substantially. So one step is not inherently the problem — something is being lost inside that step.

Third, a local sensitivity analysis: the consequences of visual prediction error for action accuracy are highly unequal. Errors in some regions are nearly harmless; errors in others destroy the action. The problem is thereby restated as action sufficiency — a single-step predicted future must preserve the components that causally affect the action.

DirectWAM converts pretrained video and action experts into single-step predictors without stochastic sampling while retaining the explicit future-to-action cascade, which is action-sufficient distillation. The more interesting half is how the future predictor is trained: after learning a one-step action model, the future predictor decodes actions from its own predicted futures and backpropagates demonstration action error through the frozen expert, with an optional future-latent reconstruction loss. The student’s future is thus judged by its downstream control consequences rather than by representation matching.

Results

• 97.1% average success across four LIBERO suites and 85.4% on RoboTwin 2.0.
• Outperforms Flash-WAM at the same one-evaluation-per-stream budget.
• The advantage extends to three real-world tasks designed by the authors.
• Inference latency falls by 28.0x relative to the full iterative teacher.

Limitations

The method depends on an already strong teacher: distillation cannot exceed it, and the paper does not decompose where the teacher itself fails. The three real-world tasks are author-designed and their scale and difficulty are not quantified in the abstract, so the generalisation boundary of the hardware results is unclear. A single-step future may be insufficient in genuinely multimodal situations — for instance when several equally reasonable approach directions exist before contact, collapsing the distribution to a point discards alternatives the iterative teacher could have explored. The sensitivity analysis is also performed on the authors’ chosen WAM; a different backbone would have a different error-sensitivity profile, requiring the action-sufficiency implementation to be recalibrated. Finally, the 28x figure is relative to the full teacher, and no absolute millisecond latency is reported, so it is not possible to check it against a specific robot’s control frequency.

Industry Implications

For teams planning to put a world-action model on hardware, the contribution is a concrete engineering trade-off: the stochasticity of future prediction can be discarded, the decision-relevant content cannot. Acceleration should therefore not start with blindly cutting sampler steps; it should start with an error-sensitivity analysis to identify which predicted components actually move the action, followed by a distillation objective targeted at those. That diagnostic procedure is reusable on its own.

In deployment terms, a 28x latency reduction moves WAMs from offline evaluation tools toward policies that can run closed-loop. Many teams have treated WAMs as data augmentation or policy evaluators precisely because inference was too slow; if single-step versions fit inside the control period, the boundary between WAM and VLA blurs — a policy can be fast while still modelling the future explicitly. The caveat is that distillation means redoing the pipeline every time the base model changes, so it should be treated as standing infrastructure rather than a one-off script. And a 97.1% simulation number still means little on hardware: three in-house tasks demonstrate feasibility, not robustness.