OSWAM: One Denoising Step Is Enough for a World Action Model

World action models have become a credible alternative to end-to-end policies: instead of predicting future video frames and then inferring actions, they generate actions directly while still carrying a learned model of how the world evolves. The direct-policy variant is efficient precisely because it skips explicit visual prediction. It is still, however, a diffusion model, and diffusion means tens of denoising iterations. On a robot arm or a car, tens of network evaluations per control tick is the difference between a demo and a deployment.

The obvious shortcut, simply cutting the number of steps, is known to fail. A diffusion trajectory that resolves a multimodal action distribution over many small refinements collapses into coarse updates when squeezed, and action quality drops with it.

Core innovation

OSWAM’s argument is causal rather than empirical: models need many steps because they start from unstructured Gaussian noise, and the network must therefore reconstruct both the physical situation and the action structure from scratch at every sample. Give the process a better starting point and the iteration count stops being load-bearing.

Imagination tokens as initialization. Rather than pure noise, the diffusion process is initialized with learned tokens that encode physical priors and action-conditioned representations. The denoiser begins near the manifold of plausible actions instead of far from it, which is what allows a single step to land somewhere useful.

Privileged information distillation with future conditioning. Training additionally distils privileged information into the model under future conditioning, sharpening its ability to generate actions that are consistent with what happens next rather than merely plausible in the moment.

One-step generation as the deployment mode. The result is an action generator whose inference is a single denoising pass, which is what makes compiled real-time execution possible.

Results

• On both autonomous driving and embodied control, OSWAM is reported as comparable to or better than direct-policy WAMs and joint world-action models that require tens of denoising steps.
• Roughly 3x speedup over the direct-policy WAM baseline.
• Compiled inference latency as low as 40 ms on an NVIDIA RTX 5090, i.e. real-time rates for the control loops considered.

The speedup is measured against the same family of models, so it reflects the step reduction rather than a smaller backbone. Keeping quality while removing the iteration is the substantive claim; the 40 ms figure is what turns it into an engineering option.

Limitations

The abstract names the two application domains but not the benchmarks, datasets or success metrics, and “comparable or even better” is a qualitative statement without per-task numbers or variance. The one-step regime is likely to reduce the diversity of generated action modes, which matters most exactly where multimodality matters: ambiguous instructions, symmetric grasps, crowded scenes. Training depends on privileged information and future conditioning, which must be available in the training pipeline even though it is not needed at inference; how sensitive the method is to the quality of that signal is not reported. The 40 ms number comes from a flagship desktop GPU, so onboard and embedded latency remains unknown.

Industry implications

For anyone shipping learned policies, inference cost is a first-order constraint: it sets control frequency, hardware bill of materials and thermal budget. A one-step action model at 40 ms changes the architecture of a deployment, because the policy can now sit inside the control loop instead of running asynchronously behind it with a prediction horizon that must absorb jitter. It also opens the automotive case, where a planner must react within a control cycle and where the model can share a GPU with perception. The remaining question for buyers is robustness of the single-step distribution, which is exactly what the missing quantitative evaluation would settle. Teams evaluating this class of model should ask for per-task success and mode-coverage numbers under the one-step setting, not just aggregate parity.