SLIM-0.5B: Learning Action-Grounded Predictive Latents for Robot Manipulation
SLIM is a compact 0.5B-parameter latent interaction policy that learns action-grounded predictive latents — representations capturing both action-conditioned future transitions and the actions that explain observed changes — through self-supervised masked trajectory prediction combining action reconstruction with future-latent prediction. A compact Mixture-of-Transformers backbone models interactions between observation latents and action tokens, and the policy is trained with flow matching for language-conditioned action generation. Across simulation benchmarks and real-world evaluation, SLIM matches or exceeds representative large-scale VLA and world-action-model baselines with fewer parameters, no additional embodied pretraining, lower inference latency, and substantially lower GPU memory usage.
Paper · arXiv:2608.09771Background
Vision-language-action (VLA) policies typically rely on large multimodal backbones that jointly perform perception, language conditioning, and action generation at every control step. Much of that capacity serves open-domain semantics, but continuous robot manipulation mostly needs compact representations of observations, actions, and the transitions actions induce. Pixel-level world models offer an alternative route, yet predicting visual details irrelevant to control is unnecessarily expensive. The result is a landscape where capable policies are large, slow, and memory-hungry, which limits where and how they can be deployed.
Core Innovation
SLIM is a 0.5B-parameter latent interaction policy that learns action-grounded predictive latents: representations that simultaneously capture action-conditioned future transitions and the actions that would explain observed changes. The representations are learned through self-supervised masked trajectory prediction, combining action reconstruction with future-latent prediction, so no additional embodied pretraining or large-scale demonstration curation is required. A compact Mixture-of-Transformers (MoT) backbone models interactions between observation latents and action tokens, and the policy is trained with flow matching for language-conditioned action generation. The design deliberately focuses model capacity on control-relevant structure rather than open-domain visual detail.
Results
Across simulation benchmarks and real-world evaluation, SLIM matches or exceeds representative large-scale VLA and world-action-model baselines while using fewer parameters, requiring no additional embodied pretraining, and offering lower inference latency and substantially lower GPU memory usage. The combination of results indicates the efficiency gains do not come at the cost of task performance, making the compact architecture competitive across the board rather than merely a lightweight compromise.
Limitations
The abstract reports comparative results against representative baselines without per-task breakdowns, so the magnitude of the performance parity and the specific tasks where gaps remain are not yet public. Evaluation coverage across diverse embodiments, long-horizon tasks, and failure-prone real-world conditions needs further detail. The Mixture-of-Transformers design introduces routing complexity that will benefit from independent reimplementation and stress-testing.
Industry Implications
Deployment cost — GPU memory, latency, and pretraining data requirements — is a first-order constraint for commercial manipulation systems. A 0.5B policy that matches large VLA and world-action-model baselines opens the door to edge and on-robot inference, cheaper fleets, and faster control loops, without sacrificing the language-conditioned generality that makes VLA policies attractive. For integrators evaluating embodied foundation models, SLIM represents a concrete data point that model size and embodied pretraining may not be prerequisites for strong manipulation performance.