Let Coding Agents Build the Simulator: RoboWorld's 25 Scenes and 200 RL Environments

The most asymmetric thing in robot learning right now is the pace of progress on the policy side versus the environment side. Every year brings new architectures, new pretraining objectives, new data recipes. Environments, meanwhile, still come from a handful of large teams hand-building scenes. Training a model that can work in an arbitrary kitchen needs thousands of scenes that are physically coherent and tasks that are clearly specified — not another manipulation benchmark.

The authors make the causal argument explicit: building a simulation is fundamentally a coding task. If code-writing ability is improving quickly, the bottleneck on simulation supply should move down the stack. The only question is how to make what a coding agent produces both realistic and evaluable.

Core innovation

Tasks chosen by economic value, not research convenience. Scene selection is driven by U.S. GDP data on the physical work that employs people, which biases the whole environment set toward the actual structure of labor rather than the handful of grasps that are easy to instrument. The criterion looks mundane, but it determines whether the benchmark can answer the question that matters: what should robots learn to do first?

A written definition of a good simulation. The paper states explicitly what makes a simulation good and what makes a task good, then runs an adversarial creation-and-audit loop that checks every generated scene and task against those definitions. This is what separates a generative pipeline from something usable as an evaluation: without the audit, coding agents readily produce scenes that look right and behave physically wrong.

RoboWorld: 25 simulations, 25 test environments, 175 training environments. Difficulty is stratified and train/test are separated, producing an RL environment collection built for continued use rather than a one-off demo.

Four routes to stronger frontier models. In-context learning across repeated attempts; a privileged teacher that reads simulator state and teaches a student in context; self-assisted learning from the model’s own privileged experience; and code policies that generate demonstrations across varied scenes to train vision-language-action models such as π0.5.

Results

The most informative number is a negative one: even the strongest frontier models fail on every RoboWorld test task, averaging a reward of only 0.06. That is not a benchmark tuned to be impossible; it says that current models have almost no transferable competence on tasks that require reasoning about a physical process and planning actions through it.

The paper reports that all four improvement routes deliver substantial gains. What they share is worth noting: none of them changes the model architecture. They change how the model interacts with the environment — retry, get taught by something that can see state, or generate large numbers of demonstrations in code. That is consistent with the original motivation. When environments become cheap, gains can come from interaction design rather than parameter count.

The pipeline, RL environments, and benchmark are released.

Limitations

The abstract gives no per-route gain figures, only qualitative claims of substantial improvement, so it is impossible to tell which route pays best. The 25 simulations cover GDP-weighted physical work, a criterion tied to the structure of the U.S. economy; how representative that is of agriculture, construction, or care work depends on how the weights were applied, which the abstract does not detail. GDP weighting also carries a bias the paper does not address: high economic value does not imply present-day feasibility, and the selection process for excluding tasks robots cannot yet attempt is unexplained. Finally, there is no controlled comparison of how well agent-generated simulations transfer compared with hand-authored ones — which is precisely the claim that most needs evidence.

Industry implications

For companies building embodied AI, the value here is less RoboWorld itself than the engineering pattern it demonstrates: scene supply as a continuously producing, adversarially audited code pipeline. Hand-building one high-quality manipulation scene costs person-weeks; once the pipeline works, the marginal cost becomes inference cost.

The second transferable piece is evaluation design. A benchmark on which every frontier model scores 0.06 is a poor leaderboard in the short term but an excellent internal diagnostic — it states plainly how far current capability sits from economically meaningful physical work.

The third is the lesson from the four improvement routes. In a world where simulation is cheap, performance can come from context, from distilling privileged information, and from automatically generated demonstrations, without waiting for a larger model. For teams with limited budgets trying to close a gap on real tasks, that is the more realistic cost structure.