SymmGrid: Super-Scaling On-Robot Learning with Parallelized Symmetries and Egocentric-Exocentric Visual Perception

· Editorial Team estimated
on-robot learning symmetry manipulation real-time learning reinforcement learning

SymmGrid uses parallelized symmetry transformations to dramatically accelerate on-robot reinforcement learning. Real-world manipulation tasks achieve 1.37-2.17× wall-clock training speedup, with convergence in as little as 10.9-16.6 minutes for peg-insertion and cable routing, and up to 2.59× improvement in normalized AUC.

Paper · arXiv:2607.26985

Background

Deep reinforcement learning directly on physical robots — on-robot learning — remains bottlenecked by slow wall-clock training times. While simulation-based approaches benefit from massive parallelization, real robots run in real time, and each action has a physical duration that cannot be accelerated. Existing methods for improving sample efficiency often rely on simulation-based pretraining or large offline datasets, limiting their applicability to settings where robots must adapt online to new environments.

Core Innovation

SymmGrid is a trajectory-level augmentation framework inspired by parallelized symmetries. The core insight is that many manipulation tasks have inherent geometric symmetries: rotating a peg-insertion scene by 90°, for example, should produce an equivalently valid experience. SymmGrid models the Markov Decision Process (MDP) under a symmetry tree, where state-action pairs have admissible parallelized invariant transformations that yield a geometric grid structure.

For visual observations, the framework applies homographies to warp egocentric and exocentric camera views in line with their corresponding spatial transformations. These parallelized transformations produce a large set of unique symmetric equivalences that populate the replay buffer with diverse and consistent experiences, drastically improving sample efficiency without requiring additional real-world interaction.

Results

SymmGrid was evaluated directly on real robot manipulation contact tasks: peg-insertions, cable routing, and object relocations. Relative to state-of-the-art baselines, it achieved:

  • Wall-clock training convergence speed-ups of 1.37-2.17×
  • Evaluation success rate improvements of 1.09-1.27×
  • Fastest training convergence times of 16.6 minutes (peg-insertion), 10.9 minutes (cable routing), and 79.3 minutes (object relocation)
  • Normalized AUC improvements of up to 2.59×

Limitations

The method assumes known or estimable symmetry structures for each task. For tasks without clear geometric symmetries — such as those involving non-rigid objects or asymmetric contacts — the augmentation framework may not apply directly. The evaluation focuses on relatively constrained tabletop manipulation tasks; scaling to mobile manipulation or bimanual tasks introduces more complex symmetry structures.

Industry Implications

Achieving sub-17-minute training convergence for contact-rich manipulation tasks on real robots moves on-robot learning from a research curiosity toward practical deployment. For companies deploying robot fleets, the ability to adapt manipulation skills in minutes rather than hours means robots can be retrained on-site for new tasks without removing them from production. The symmetry augmentation approach requires no additional hardware and is compatible with standard RL algorithms, making it readily adoptable.