RoboJEPA: Scaling Robotic Latent World Models

Latent world models have become good at predicting future states and planning in the real world, but the field has had no principled way to say how much better they get as they grow. RoboJEPA’s contribution is a measurement that makes the question answerable, and a model large enough to test it.

Background

World models compress the environment into a latent space, roll it forward, and plan against the result. The Joint Embedding Predictive Architecture (JEPA) does this by predicting in representation space rather than in pixels, which tends to be cheaper and more semantically stable than pixel-space prediction. The practical problem is one of forecasting: without a reliable account of how capability scales with model size, data and compute, progress is guesswork, and every real-robot evaluation is expensive to run. The paper sets out to supply that account for the multi-embodiment robot setting.

Core Innovation

RoboJEPA is a JEPA-based world model trained on a large-scale dataset spanning 12 robotic embodiments. Two design choices carry the result. First, the dataset spans many embodiments, so the scaling story is not tied to a single robot. Second, and this is the paper’s headline, the authors show that imagination error, the error of the model’s latent rollouts, follows a second-order power law in compute. That law is predictive, not merely descriptive: it lets them forecast model quality well beyond the compute scale at which it was fit. Downstream robotic planning performance improves predictably with compute as well, and imagination error is strongly correlated with it, which turns the error signal into a usable stand-in for costly real-robot evaluation.

Results

• RoboJEPA’s imagination error follows a second-order power law in compute, enabling extrapolation beyond the fitted scale.
• Downstream planning performance improves predictably with compute and correlates strongly with imagination error.
• The model can be deployed zero-shot as a robotic agent, planning toward a single goal image to solve tasks requiring long-horizon planning on real hardware.
• At 8B parameters it is the largest JEPA predictor trained to date.
• All model checkpoints, together with the training and robot deployment code, are released.

Limitations

The claim of a first scaling law for multi-embodiment robotic world models is only as strong as the spread and quality of the underlying 12-embodiment dataset, which the abstract does not characterize in detail; embodiment balance, task diversity and how much each robot contributes are unstated. Zero-shot deployment is demonstrated toward a single goal image, a narrow slice of what real planning demands, and the abstract reports no success rates or horizon lengths for those real-robot tasks. The power law is fit over a limited compute range, and extrapolation is a promise about the fit rather than a guarantee about the world; second-order fits can be fragile outside their fitting window. Finally, whether imagination error remains a good proxy under distribution shift is not established.

Industry Implications

For robotics organizations deciding how to spend training compute, an imagination-error law is a planning tool: it turns model quality from an after-the-fact measurement into a forecast, and it substitutes a cheap latent-space signal for expensive real-robot evaluation. That is precisely the lever a team needs when it must commit budget before it has a robot fleet to test on. The multi-embodiment framing is equally important, because a scaling law that holds across 12 embodiments is more useful than one tuned to a single platform, suggesting the result is about the architecture and the data regime rather than one particular robot. Releasing the 8B checkpoints and deployment code lowers the barrier for others to test their own workflows against a strong open baseline, which is the fastest way to find out where the proxy breaks.