Reflex: Real-Time VLA Control through Streaming Inference

Flow-matching Vision-Language-Action (VLA) models offer precise continuous control for robotic manipulation, but their iterative denoising nature has created a fundamental incompatibility with real-time deployment: global timestep injection invalidates key-value (KV) caching, forcing practitioners to choose between expensive O(N²) recomputation and mathematically incorrect cache reuse. Reflex breaks this trade-off by exploiting a property the authors term timestep invariance—the observation that perception encoders in flow-matching policies operate independently of the denoising loop.

Core Innovation

The key insight of Reflex is partitioning the attention context into three regions—static (persistent visual features), sliding (recent observations), and dynamic (denoising-step-specific)—enabling O(1) incremental cache updates while preserving full-batch-equivalent attention outputs for fixed inputs. This architectural realization allows the model to reuse KV caches across denoising steps without approximation errors, directly attacking the root cause of slow inference in flow-matching policies.

To maintain numerical stability during continuous high-frequency inference, Reflex introduces AdaRMSNorm, an adaptive normalization layer that gates on the flow phase to prevent BFloat16 numerical collapse—a problem that emerges when running hundreds of sequential denoising steps in production. An asynchronous pipeline decouples visual encoding from action generation, while operator fusion reduces kernel launch overhead.

Results

On the LIBERO and Kinetix benchmarks, Reflex achieves:

• 2.58× inference speedup over standard flow-matching VLA implementations
• 50 Hz stable streaming, enabling real-time control loop closure
• Up to 54% reduction in reaction latency, critical for dynamic manipulation tasks
• No degradation in task success rates compared to full-batch inference

Notably, these gains are achieved without changes to the underlying policy architecture—Reflex operates at the inference engine level, making it broadly applicable to any flow-matching VLA model.

Limitations

The timestep-invariance property has been empirically validated across the tested benchmarks but lacks formal theoretical proof. The current implementation targets the specific KV-cache structure of Transformer-based flow-matching architectures; applicability to other denoising paradigms (e.g., consistency models) has not been demonstrated. Real-world deployment was demonstrated on a 7-DoF Franka arm but only in controlled lab settings.

Industry Implications

This work addresses the single most critical bottleneck preventing VLA models from transitioning from research demonstrations to production robotic systems: real-time inference. As the robotics industry increasingly adopts VLA policies for general-purpose manipulation, Reflex provides a path to running these computationally demanding models at control-loop frequencies without specialized hardware. The engineering contribution—KV-cache reuse for iterative policies—is directly applicable to any organization deploying flow-matching models, from warehouse automation to surgical robotics.