PAKT: Kinesthetic Teaching That Respects What the Robot Can Actually Do

· Editorial Team estimated
reinforcement-learning industrial-manipulation kinesthetic-teaching admittance-control impedance-control human-in-the-loop contact-rich-assembly

Real-world reinforcement learning still struggles with contact-rich industrial manipulation, where the demands are micrometre-level precision, success rates above 99 percent and human-level cycle times. Off-policy methods can get there by exploiting demonstrations and human interventions, but the bottleneck is a missing interface: never mind the algorithm, how does a person on a factory floor supply guidance that is both intuitive and physically consistent with what the robot and the policy can actually reproduce? PAKT is a framework for kinesthetic teaching in reinforcement learning. Instead of teleoperation it uses kinesthetic guidance, the method industry already relies on, but it fixes that method's classic weakness: an operator can drag the robot along trajectories whose velocities, accelerations and jerk the robot or policy cannot physically reproduce. In PAKT the operator guides the robot through admittance control, which maps human-applied forces to motion, and a downstream reference generator applies the same kinematic limits used during policy execution, so every collected trajectory stays inside what the system can reproduce. Supporting this interface is a high-performance control stack that maps low-frequency RL actions to high-frequency torque commands through a reference generator and an impedance controller, where the reference generator preserves the impedance controller's tracking performance while improving contact handling and producing smoother policy actions. Across reported runs on four insertion and industrial assembly benchmarks, including a data centre compute tray, the end-to-end system cuts cycle time by 23 to 48 percent and cumulative intervention count by 62 to 86 percent relative to the HIL-SERL baseline.

Paper · arXiv:2609.25630

The pitch for real-world reinforcement learning in manufacturing is straightforward: let the robot practice the insertion, let a human correct it when it fails, and let the data accumulate until success rates climb past what a hand-tuned program can reach. The part that stalls in practice is not the algorithm. It is the human interface — how, exactly, someone on a factory floor teaches and corrects a policy without fighting the machine.

Kinesthetic teaching is the answer industry already accepts: the operator takes the robot by the wrist and moves it where it should go. It is intuitive and it needs no extra hardware. Its classic weakness is that the operator can move the robot in ways the robot will never be able to move itself.

Background

Contact-rich industrial manipulation sets three requirements simultaneously: micrometre-level precision, success rates above 99 percent, and human-level cycle times. Off-policy reinforcement learning that exploits demonstrations and interventions can plausibly meet them, and methods in the HIL-SERL family have shown it. The bottleneck the paper identifies is the guidance-collection interface. Whatever the algorithm, someone has to supply demonstrations and corrections, and that supply has to comply with the constraints of the physical system and of the policy, or the collected data is unusable in ways that are hard to detect. Teleoperation is the common research answer; kinesthetic guidance is the common industrial one, and it is the one this paper builds on.

Core Innovation

PAKT is a framework for kinesthetic teaching in reinforcement learning with two connected pieces:

  • Admittance control plus a limit-respecting reference generator. The operator guides the robot through admittance control, which maps human-applied forces to motion — the natural, force-based way for a human to move a compliant robot. The downstream reference generator then applies the same kinematic limits that are used during policy execution, so the trajectory recorded from the human stays within what the robot and the policy can actually reproduce. The recorded teaching data is therefore physically realisable by construction, rather than being filtered or discarded after the fact.
  • A control stack that bridges rate and capability. RL actions are low-frequency; torque control is high-frequency. PAKT adds a reference generator and an impedance controller to translate between them, where the reference generator preserves the impedance controller’s tracking performance while improving contact handling and producing smoother policy actions.

The second piece is not decoration. Contact-rich insertion needs a controller that behaves well when the parts touch, and a policy whose commands are smooth enough that the arm and the fixture do not absorb every command as a jerk.

Results

  • Benchmarks: four insertion and industrial assembly tasks, including a data centre compute tray.
  • Cycle time: reduced by 23% to 48% relative to the HIL-SERL baseline.
  • Interventions: cumulative intervention count reduced by 62% to 86% relative to the same baseline.
  • A project website is provided.

For a deployment decision these are the right two metrics. Cycle time decides throughput and therefore payback; intervention count is a direct proxy for how much operator attention the cell consumes, and therefore for how many cells one person can supervise.

Limitations

HIL-SERL is the only baseline reported in the abstract, so the gains are relative to one strong but single reference point rather than to a spread of human-in-the-loop methods or to classical force-controlled assembly programs. The benchmarks are four insertion and assembly tasks, including one concrete industrial example; whether the interface and the limit-respecting reference generator carry over to different part geometries, clearances, tooling and controllers is not established by that set. The paper’s opening demand of micrometre precision and above-99-percent success is stated as what the domain requires, and the abstract does not report absolute success rates — so it is not shown here that these numbers were reached, only that cycle time and intervention counts improved. Kinesthetic teaching still requires a person at the robot, and the ergonomics and skill dependence of that role, plus how much training time the approach needs in total, are not quantified. Finally, admittance control maps human force to motion, which raises safety questions about force limits and e-stop behaviour that the abstract does not address, and the reported intervention counts depend on how an intervention is defined.

Industry Implications

The reason this lands as an industrial result rather than a research curiosity is that it starts from the interface industry already has. Kinesthetic teaching is what a technician does today when they push a robot through a motion, and the paper’s key observation is that the recorded motion is being polluted by commands the machine cannot execute. Fixing that at the point of collection — by enforcing the same limits that apply at run time — is a small change with an outsized effect on whether learned policies are trainable on the data a factory can actually generate.

The control-stack half matters just as much for integration. Mapping low-frequency policy commands to high-frequency torque through a reference generator and impedance controller is the shape of every serious industrial deployment, and getting smooth actions and good contact handling out of that layer is what makes a learned policy behave like a machine tool rather than like a script that happens to work. For a team weighing learned assembly against engineered assembly, the metrics to watch are the ones reported here: cycle time, because it is the payback calculation, and interventions per hour, because it is the staffing calculation.