MiDAS: Adaptation of Generalist Robot Policies with Minimal Data

· Editorial Team estimated
robot-learning offline-to-online-rl few-shot-adaptation VLA bimanual-manipulation

MiDAS studies minimal-data adaptation: a pretrained policy learns a new task from as little as one demonstration, anchored by behavior cloning and then improved through value-based online RL on a residual policy parameterization. It recovers strong performance on LIBERO and RoboCasa from a single demo and improves a fragile policy on a bimanual YAM platform over ~6 hours of online interaction — per the paper, the first reliable robot policy adaptation from a single task demonstration.

Paper · arXiv:2608.11363

A central goal in robot learning is to move beyond task-specific human data collection toward robots that improve through autonomous interaction. Yet fully autonomous learning remains difficult with current policies: sparse rewards and weak zero-shot exploration make it unlikely that a robot will discover successful behavior from scratch. MiDAS targets a more tractable and directly relevant regime — minimal-data adaptation — in which a pretrained policy must learn a new task from as little as one demonstration followed by autonomous online interaction.

Core Innovation

MiDAS is a simple offline-to-online RL recipe in two steps:

  1. Behavior-cloning anchoring: anchor a pretrained VLA to the target task with behavior cloning on a single (or a few) demonstration(s), yielding a fragile but usable initial policy;
  2. Value-based online RL on a residual policy parameterization: let the robot improve through autonomous interaction, generalizing beyond demonstrated conditions.

Because this setting is the closest tractable proxy for fully autonomous improvement, it allows a systematic study of whether minimal human guidance can bootstrap autonomous learning — and which algorithmic ingredients make it feasible.

Results

  • On LIBERO and RoboCasa, MiDAS recovers strong task performance from as little as one demonstration, substantially outperforming baselines and generalizing beyond demonstrated conditions;
  • On a bimanual YAM platform, starting from a fragile low-success policy obtained from a single demonstration, it improves robustness and learns new successful behaviors over ~6 hours of online interaction;
  • Per the paper, this is the first demonstration of reliable robot policy adaptation from a single task demonstration.

Limitations

Results are self-reported. Real-platform validation is limited to a single YAM platform, and both the ~6-hour online interaction budget and the sensitivity of value-based RL on residual parameterizations need more cross-platform evidence. The minimal-data regime still requires at least one demonstration and a safe online interaction setup; it is not yet zero-data autonomous exploration.

Industry Implications

MiDAS attacks the data-collection bottleneck directly: one demonstration can bootstrap a new task, and a deployed robot keeps improving through autonomous interaction — attractive for warehouse, home-service, and humanoid applications. The recipe builds on existing VLAs without architectural changes, lowering adoption barriers. If the “demo to bootstrap, autonomy to improve” pattern reproduces across more platforms, it could change how robot skills are delivered in practice.