Dynin-Robotics: An Omnimodal Unified Diffusion Vision-Language-Action Model

Visual goal prediction and dynamics prediction are complementary: the first says what outcome to aim for, the second how an action reshapes the scene. They are usually treated as separate modules or auxiliary losses, disconnected from action generation itself.

Core Innovation

The paper brings both into action generation and selection by sharing a single trajectory model between them. It is implemented on Dynin-Omni, an omnimodal masked-diffusion backbone that represents language, visual observations, goals, and actions as discrete tokens.

The key design is that varying only the conditioning and target spans lets one model learn four objectives at once: action prediction, action-conditioned next-observation prediction, terminal goal-state prediction, and trajectory-to-instruction reconstruction. That uniformity in turn supports test-time scaling — improving behavior through goal prediction, action-candidate evaluation, and joint refinement of action and future-state predictions.

Results

• Continual pretraining on roughly 1.33 million trajectories from 48 Open X-Embodiment datasets, followed by separate downstream adaptation.
• On two VLABench tasks, robot pretraining improves adaptation within a fixed Stage-2 step budget, and the full objective mixture improves success under shifted instructions relative to policy-only post-training.
• Combining goal guidance with joint action-next-state denoising improves shifted-instruction success over action-only decoding — but the benefit depends on how the predictions are composed.
• Competitive performance on LIBERO and zero-shot LIBERO-Plus; a 78.4% average success rate across four manipulation conditions on a Franka Research 3.
• An optimized block-parallel implementation accelerates model-side action decoding by up to 29.2x under the reported profiling setup.

Limitations

The abstract gives no actual LIBERO or LIBERO-Plus numbers, so “competitive” cannot be quantified, and it reports neither per-task failure modes nor worst-case behavior. Because the gains are sensitive to how predictions are composed, the unified objective is not plug-and-play and needs per-task tuning. The 29.2x speedup is measured under a specific profiling setup and is not shown to translate into end-to-end control-loop latency; the abstract also omits model scale, inference hardware, and whether code is released.

Industry Implications

Placing actions, future observations, and terminal goals in one backbone over one token vocabulary means work that previously needed several specialized modules — policy, evaluator, goal generator — can be carried by a single model, cutting model-management and version-drift costs. More practically, “goal prediction plus action-candidate evaluation” turns compute into reliability through a direct knob: spend more inference budget on safety-critical tasks and fall back to single-pass decoding on routine ones. The roughly 29x decoding speedup speaks directly to whether such a model can be run at control rates on real hardware.

---