CLIFT: Turning Gemini Robotics On-Device into Humanoid Specialists via Non-Invasive Closed-Loop Iterative Fine-Tuning

Background

The strongest robot foundation models are typically trained on proprietary data and remain closed-source, which limits downstream users’ ability to adapt them to new tasks, embodiments, and deployment settings. Following the LLM community, an emerging access paradigm for closed-weight robot foundation models is the managed supervised fine-tuning (SFT) API: users submit training data and receive a tuned policy — without access to model weights, gradients, or training internals. While such APIs let downstream users leverage powerful proprietary models, they restrict policy improvement to pure imitation, ruling out reinforcement learning and other closed-loop methods that depend on internal training signals. This limitation is especially acute for agile, contact-rich humanoid manipulation, where the gap between policy outputs and deployed behavior is large due to novel states, action tracking dynamics, latency, and controller-specific failure modes.

Core Innovation

CLIFT (Closed-Loop Iterative Fine-Tuning) is a method for realizing closed-loop improvement inside the managed-API regime. Instead of trying to “open the model box,” CLIFT turns deployment-time reward feedback into API-compatible supervised data: each deployment cycle produces corrective demonstrations that are submitted back through the SFT API, so the policy improves iteratively without ever accessing weights, gradients, likelihoods, or losses. The paper also contributes one of the first empirical studies of managed-API adaptation on a real humanoid, instantiated on Gemini Robotics On-Device (GROD), comparing it directly against a leading open-weight VLA trained on the same demonstrations.

Results

Direct SFT through the managed API substantially outperforms the leading open-weight VLA trained on identical demonstrations, yet still falls short of deployment-level mastery on agile, contact-rich tasks. Running CLIFT’s flywheel closes that gap: after two cycles of deployment-time feedback converted into API-compatible training data, GROD reaches near-perfect success — all without opening the model box.

Limitations

The study is instantiated on a single managed API (GROD) and a specific humanoid setup, so generality across APIs, embodiments, and task families remains to be demonstrated. The flywheel depends on obtaining reliable reward signals at deployment time, which can be expensive or noisy to collect in practice. Details of the closed-loop data conversion also rely on the API’s tolerance for iterative resubmission, which may vary by provider.

Industry Implications

For the many robotics teams building on closed foundation models, CLIFT offers a practical route to specialization without weight access — directly relevant to humanoid OEMs, robotics software vendors, and enterprises deploying foundation-model policies in contact-rich settings. It reframes closed-loop tuning as a service: managed APIs plus deployment-time feedback can deliver task mastery that pure imitation cannot. This points toward a new commercial pattern in which foundation-model providers and integrators share the loop, and it raises the bar for what open-weight alternatives must achieve to stay competitive on agile humanoid manipulation.