$\pi\mathbf{R}^2$: Reactive Real-time Flow Policies

Background

Generalist manipulation policies increasingly use action-chunking flow policies built on large pretrained backbones. These chunks run open-loop for the chunk duration, so the policy cannot react to sensory input arriving mid-execution. While replanning more frequently would restore reactivity, the perception-to-action pipeline — a large backbone plus multiple denoising steps — is too slow, creating a fundamental tension between model capacity and closed-loop control frequency.

Core Innovation

πR² makes large-backbone flow policies reactive and real-time through two key ideas. First, it splits policy conditioning into a fast channel (proprioception, updated every control tick) and a slow channel (vision-language features, updated asynchronously), so the policy can react to joint angles and forces within a chunk while tolerating stale visual information. Second, a latency-adaptive flow schedule treats in-flight actions as inpainting conditioning and emits actions in a single denoising step per call, allowing one trained model to adapt to varying hardware latency.

Crucially, πR² requires only minimal modification to existing architectures and can be fine-tuned from a pretrained policy. The authors demonstrate this by applying it to GR00T-N1.7 on a real xArm6+XHand platform.

Results

πR² replans closed-loop approximately 4× faster than the base policy, achieving roughly 25 Hz on an A5000 GPU with a fresh observation every 40 ms. Across simulation and real-world manipulation tasks, it improves success rate by up to 23% in simulation and 30% in the real world over the strongest baseline.

Limitations

The dual-channel design assumes proprioception alone is sufficient for mid-chunk corrective reactions. For tasks requiring fine-grained visual feedback mid-chunk (e.g., visually guided insertion), the stale vision channel may still impose a ceiling on performance. The approach is demonstrated on a single-arm setup; extension to bimanual coordination is not explored.

Industry Implications

For teams deploying large VLA models on physical robots, πR² addresses the critical deployment bottleneck of closed-loop reactivity. Achieving 25 Hz replanning with a large backbone like GR00T-N1.7 on commercially available GPU hardware (A5000) is a practical milestone. The minimal-architecture-change requirement means existing deployed policies can be upgraded to πR² without complete retraining, lowering the adoption barrier for real-world robotic systems.