When Do Discrete Actions Make Good Continuous Controllers?

· Editorial Team estimated
action-representation discretization vision-language-action flow-matching diffusion-policy robot-foundation-models

Today's robot foundation models represent actions as continuous vectors, as if that were a given. This paper asks directly whether continuous parametrization is actually superior to discrete. Across simulation and real hardware, and in both from-scratch single-task and multi-task VLA training, the authors systematically compare continuous and discrete policies in single-step regression and multi-step flow variants. The finding is consistent: discrete action prediction — even the most naive uniform-bin quantization — matches or exceeds continuous policies in task success rate. They further identify the true bottleneck as factorization error from product-distribution predictions across time and action dimensions, not action precision. Paired with the right interventions — iterative computation via discrete flows, or distribution sharpening through classifier-free guidance — this weakness becomes a strength, enabling more responsive action changes within a predicted action chunk. Explicitly injecting geometric information into discrete policies, by contrast, does not yield consistent gains.

Paper · arXiv:2610.20429

Robot foundation models almost universally assume actions are continuous vectors. This paper takes that default and puts it to the test.

Background

Modern AI models such as large language models predict discrete tokens, yet today’s leading robot foundation models represent actions as continuous vectors. Most work treats this as a given, rarely asking whether continuous parametrization is genuinely better for robot actions. If discrete representations work just as well, then the architectural choices for robot policies might not need to part ways with the rest of AI. That is the question the authors set out to test.

Core Innovation

The authors run a systematic comparison: across simulation and real hardware, they contrast single-step regression and multi-step flow variants of both continuous and discrete policies, spanning from-scratch single-task training and multi-task VLA training. On that basis they offer a mechanistic explanation: the challenge for discrete policies is not action precision but the factorization error introduced by product-distribution predictions across time and action dimensions. Following that diagnosis, they show two interventions — iterative computation through discrete flows, or distribution sharpening via classifier-free guidance — that convert the weakness into a strength, letting the policy change actions more responsively within a predicted chunk. They also test directly injecting geometric information into discrete policies (for example, corruption processes that emulate continuous flow matching) and find inconsistent gains.

Results

  • Across every regime tested, discrete action prediction — including the most naive uniform-bin quantization — matches or exceeds continuous action policies in task success rate.
  • The bottleneck for discrete policies is identified as factorization error, not action precision.
  • With discrete-flow iterative computation or classifier-free guidance, discrete policies change actions more responsively within an action chunk.
  • Explicitly injecting geometric information does not yield consistent improvements.

Limitations

The abstract leads with success rates and does not report the smoothness, jitter or execution energy that continuous control usually cares about — metrics that matter for whether discrete can truly stand in for continuous. The scale and task coverage of the hardware experiments are not detailed, so the strength of the conclusion on long-horizon, high-precision contact tasks remains to be confirmed. The factorization-error diagnosis is illuminating, but the abstract does not hand readers a general fix to drop onto a new method.

Industry Implications

If discrete actions match continuous ones, the implications are structural: robot policies need not depend on a separate continuous-control design and can instead reuse the discrete-modeling toolkit that the language-model world has already matured — next-token prediction, classifier guidance, discrete diffusion. A lower barrier to entry means more teams can adapt existing language models to emit actions directly, and inference and deployment paths may simplify. For companies building robot foundation models, the finding is worth reproducing on their own stacks, because what it unsettles is precisely the assumption that actions must be continuous.