Diffusion ReRoll: Revisable Denoising for Robotic Sequential Prediction

Background

Existing diffusion-based sequence predictors typically perform a single monotonic denoising process — once a region of the prediction stabilizes, it cannot be revised using information from other parts of the sequence. This rigidity limits the quality of long-horizon predictions because earlier and later segments cannot inform one another.

Core Innovation

Diffusion ReRoll selectively re-noises regions of a diffusion trajectory that have become locally stable while the remaining regions continue denoising, so the re-noised regions can be refined again using context from the rest of the horizon. This structured re-noising enables iterative cross-horizon revision, allowing earlier and later segments to revise one another while maintaining local consistency. The key insight is that optimal sequential predictions benefit from bidirectional information flow, which monotonic denoising cannot provide.

Key Results

On OGBench PointMaze and AntMaze, Diffusion ReRoll achieves relative gains in average success rate of 21% over Diffusion Forcing in matched guidance-based planning and 23% over Diffuser in matched goal-inpainting. In diffusion-policy-style action prediction, it improves average success by 56.5% relative to Diffusion Policy across different prediction horizons and history lengths on the LIBERO-10 multi-task benchmark. In unified video-action prediction, Diffusion ReRoll improves policy and inverse dynamics performance, especially under out-of-distribution evaluation, and achieves the best action-video consistency.

Limitations

The structured re-noising mechanism adds computational overhead compared to monotonic denoising. The method’s efficacy depends on the quality of the re-noising schedule and region selection strategy, which may require tuning for different domains. Long-horizon performance gains, while significant, have primarily been demonstrated in simulation and may face additional challenges in real-world deployment with noisy observations.

Industry Implications

Diffusion ReRoll advances the frontier of robotic sequence generation — a core capability for planning, policy learning, and video-action modeling. By enabling bidirectional revision of predictions, it produces higher-quality long-horizon plans and more consistent video-action trajectories. This is directly relevant to autonomous navigation, long-horizon task planning, and video-based policy learning, all of which are critical for deploying robots in complex real-world environments.