AW-0: Turning World Action Models into Reusable Skill Libraries via Code

Robot learning has been advancing along two largely separate tracks. World action models (WAMs) use video generation to give a policy visual foresight, letting it preview the consequences of a movement before committing to it. Agentic robotics uses code for task planning and wraps capabilities as callable skills, buying compositionality and interpretability. Their weaknesses are complementary: WAMs predict well but emit actions end-to-end in a single pass, with no explicit mechanism for reusing a skill that has already been learned; agentic systems plan and reuse, but their skills have no predictive grounding in physical dynamics, so a code-level skill call does not actually know what the next frames will look like.

Core Innovation

AW-0 promotes code to a first-class generative modality alongside video and action. The three are modeled jointly as coupled streams within a unified mixture-of-transformers:

• a code expert generates parameterized skill routines and control logic — the executable structure of what should happen;
• a video expert generates future visual states, supplying physical foresight;
• an action expert emits low-level motor commands.

The important design choice is that code carries two jobs simultaneously. Inside the model it is the structural backbone for multi-step prediction and control: it decomposes long-horizon forecasting into semantically meaningful steps instead of letting a video model drift freely. Outside the model, the same code is a reusable program that an agentic executor can invoke on later tasks. Prediction and reuse stop being an interface problem between two systems and become two faces of one representation.

To make the skill library scale, the authors add an automated curation pipeline that labels robot and human video trajectories with aligned programs, then merges recurring routines into reusable skills. This targets the practical bottleneck of agentic methods: skill libraries are usually hand-authored and therefore do not scale.

Results

Evaluation covers the RoboTwin 2.0 benchmark and physical bimanual manipulation tasks. The authors report improved task performance over both VLA and WAM baselines, together with gains in language following, semantic reasoning and robustness, and argue that agentic code is what connects planning, prediction and execution inside a WAM.

The abstract states comparative conclusions rather than numbers: no per-task success rates, effect sizes, inference latency or training cost are disclosed, so the magnitude of the gains cannot be judged independently from the abstract.

Limitations

• No quantitative results are given; success rates on RoboTwin 2.0 and the scale of the physical bimanual evaluation are both unknown.
• Skill-library quality depends on the curation pipeline. Aligning human and robot video to program labels is a noisy step, and the abstract reports neither labeling accuracy nor skill-retrieval failure modes.
• Jointly generating three streams means running code, video and action experts at inference; real-time behavior and compute cost are the usual tax on such architectures and are not addressed.
• Real-world validation is confined to bimanual manipulation, leaving mobile, navigation and multi-robot settings untested.

Industry Implications

For teams building general manipulation stacks, the direction matters more than any single metric. If code can serve as both the structure of prediction and the interface for reuse, the shape of the data flywheel changes: each collected demonstration no longer just adds a policy sample, it can also add a retrievable, composable skill program. That is a different scaling logic from the dominant VLA path of feeding ever more data to ever larger end-to-end models — one that depends on curation and abstraction quality rather than raw volume and compute.

There is also a practical deployment argument. Code is an auditable intermediate artifact. When behavior is driven by explicit programs, failure attribution, permission constraints and rollback are all easier than with a purely end-to-end policy, which is a real advantage in industrial and home settings that require safety certification. The metrics worth watching next are skill-library hit rates under cross-task transfer, and whether three-stream inference can be pushed down to an acceptable control rate.