JAMB: Denoising Bimanual Actions and Future Geometry Together

Putting two arms on one task is not hard because a single arm is hard. It is hard because the arms share a scene: every motion of either arm rewrites the 3D relationships the other arm relies on. Diffusion policies are the standard backbone for bimanual manipulation today, yet the mainstream variant generates actions without ever modelling what the scene will look like as a result.

Background

A few predictive diffusion policies do forecast future state, but they usually treat it as auxiliary supervision — one more loss term — or as fixed conditioning, predicting first and generating actions afterwards. Neither closes the loop that matters: a predicted future cannot correct the action being denoised, and the action cannot correct the geometry hypothesis. The paper’s argument is that bimanual failures cluster precisely where one arm’s motion invalidates the spatial relations the other arm was planned against, so the two have to talk during generation, not after it.

Core Innovation

• Joint denoising of actions and future geometry. JAMB places bimanual actions and future 3D point tracks in the same Transformer and lets them evolve along a shared denoising trajectory. At each step the geometry hypothesis tells the action where objects will be pushed, and the action hypothesis pulls the geometry prediction toward what is feasible. Future geometry becomes a co-equal generative variable rather than a passive supervisory signal.
• A shared spatiotemporal coordinate system. To make cross-modal interaction geometrically meaningful, multimodal representations are grounded in a single reference frame, so actions and point tracks constrain each other in the same coordinates instead of independently.
• A matched comparison design. JAMB is evaluated against action-only diffusion policies and against future-prediction variants with different state representations and learning objectives, which separates the contribution of joint denoising from the contribution of merely predicting more.

Results

• Simulation: 83.4% average success across 16 bimanual tasks in RoboTwin 2.0, 23.9 percentage points above the strongest baseline.
• Real robot: on three real-world tasks, +50.0 and +21.2 percentage points over action-only and auxiliary geometry prediction methods respectively.
• Generalization: stronger than all evaluated baselines on cluttered scenes and out-of-distribution backgrounds.
• Project page: https://jam-bimanual.github.io/

Limitations

The abstract reports no absolute real-robot success rates, and no denoising-step count, inference latency, or training-set size, so a reader cannot judge whether the extra computation of joint denoising pays for itself. Where the supervision comes from is also unaddressed: future 3D point tracks normally require point tracking or depth, and the paper does not quantify that data cost or say how the system degrades on transparent, reflective, or deformable objects. Evaluation is confined to tabletop bimanual manipulation, leaving mobile platforms, human co-presence, and long-horizon tasks — exactly where bimanual deployment gets hard — untested.

Industry Implications

The commercial settings for bimanual robots — assembly, sorting, the home — keep confirming one thing: two independently trained arms do not add up to a coupled system. JAMB’s contribution is to write the coupling into the generative process itself, so that when the policy emits an action it has already run the scene forward through the same denoising loop. For teams productizing bimanual hardware the practical lesson is that patching conflicts between arms at the planning layer is the wrong layer; geometry prediction belongs inside the policy as a first-class citizen. The shared spatiotemporal grounding and the joint denoising are worth adopting as a default pattern for predictive policies even by groups that never run JAMB itself.