Steertuning: New Robot Tasks from Five Human Demonstrations in Five Minutes
Current robot-learning recipes need massive demonstration volumes for robust, adaptive policies, which is a poor fit for deployment where tasks and environments keep changing. Steertuning has two parts: a 400M-parameter diffusion policy pretrained on 100 hours of densely annotated egocentric human interaction, which makes the later step robust to background differences and enables spatial and object generalization; and a finetuning stage that, given just 5 demonstrations of a new task, trains for 2 minutes (2000 updates) and steers the policy's actions during reverse sampling using the demonstration closest to the deployment environment. With a data pipeline for embodiment transfer, it reaches 71% success across 12 tasks in 12 new environments, from labs to kitchens in new homes, with the whole pipeline from data collection to deployment taking under 5 minutes.
Paper · arXiv:2610.18711A new robot task normally means a new data-collection project. This paper claims it can mean five demonstrations and two minutes of training.
Background
Current recipes for robot learning need massive amounts of robot demonstrations to obtain robust and adaptive policies. That is a poor fit for real deployment, where the tasks and the environments keep changing and no team can afford a fresh large-scale collection every time. The question the paper asks is how little data and how little compute a new task really needs, once the policy starts from a broad base.
Core Innovation
Steertuning has two parts. First, a 400M-parameter diffusion policy is pretrained on an egocentric human dataset of 100 hours of densely annotated random interactions; this pretraining is what makes the later few-shot step robust to background differences and lets it generalize spatially and over objects. Second, given just 5 demonstrations of a new task, the model is finetuned for only 2 minutes (2000 training updates), and the policy’s actions are steered during reverse sampling using the demonstration whose observation is closest to that of the deployment environment. A data-processing pipeline for embodiment transfer connects the human pretraining data to the robot.
Results
- 71% success rate across 12 tasks in 12 new environments, ranging from lab settings to kitchens in new homes.
- The whole process, from collecting data for a new task to deploying the robot policy, takes under 5 minutes.
- Pretraining on the 100-hour human dataset is what enables background robustness and spatial/object generalization on new tasks.
- The dataset, model weights, codebase and robot videos are slated for release.
Limitations
71% is a substantial but partial success rate, and the abstract does not itemize where the remaining failures come from. The steering step assumes a demonstration whose observation is close to the deployment environment; when no such demonstration exists, the mechanism has nothing good to steer toward. The 12 tasks are not characterized for horizon length or contact richness, so whether the recipe holds on long-horizon or force-sensitive work is open. Finally, the real cost has not vanished, it has moved: the 100-hour, densely annotated pretraining corpus is what makes two-minute finetuning possible, and building it is a large upfront investment.
Industry Implications
The five-minute number is the one that matters. It reframes robot deployment economics from weeks of data collection per task to a coffee break, and it makes the bottleneck a single shared pretraining corpus plus a light steering step rather than per-task demonstration volume. Steering with the nearest demonstration is a cheap, deployment-friendly way to absorb environment shift without retraining the policy, which is exactly the kind of operation a field engineer can run. For home and kitchen manipulation, where task and environment diversity is the defining difficulty, this is close to the shape a product needs.