Spark-0: Scaling Spatially Aligned Tactile Pretraining for Dexterous Manipulation

· Editorial Team estimated
tactile-sensing vision-tactile-language-action dexterous-manipulation pretraining dataset robot-learning

In contact-rich dexterous manipulation, force, compliance and incipient slip are hard to observe from images. Spark-0 is a spatially aligned vision-tactile-language-action (VTLA) model: during pretraining, image-space contact maps from tactile gloves, together with features from a frozen 3D geometry teacher, supervise the visual tokens (removed at inference), while a tactile pathway encodes regional force histories and 3D taxel states to condition the action expert, so a single checkpoint serves both vision-only and tactile-conditioned deployment. The team built HumanTouch, a 1,000-hour full-hand tactile human manipulation dataset, and the paired SparkArena benchmark; retaining touch raises Ego Humanoid vision-only success from 52.5% to 71.7% and SparkArena-Real from 44.0% to 52.0%.

Paper · arXiv:2610.22342

Cameras see the object; they do not see the force, the compliance, or the slip that is about to happen — the blind spot of contact-rich dexterous manipulation.

Background

Generalist robot policies benefit from large-scale visual pretraining but still struggle with contact-rich dexterous manipulation, where force, compliance and incipient slip are hard to observe from images. A vision-only route therefore has trouble turning “what the hand feels” into a learnable signal, while tactile data has long lacked the scale to support pretraining.

Core Innovation

Spark-0 is a spatially aligned vision-tactile-language-action (VTLA) model that uses touch in two complementary ways. During pretraining, image-space contact maps generated from tactile gloves, together with features from a frozen 3D geometry teacher, supervise the visual tokens; these objectives are removed at inference. In parallel, a tactile pathway encodes regional force histories and 3D taxel states to condition the action expert. As a result, a single checkpoint supports both vision-only and tactile-conditioned deployment. To scale this supervision, the team built HumanTouch, a 1,000-hour dataset of full-hand tactile human manipulation, and pretrained Spark-0 on it together with egocentric video, robot data and simulation. They also release SparkArena, which pairs vision-only simulated tasks with tactile-conditioned real-robot tasks on one dexterous embodiment.

Results

  • Spark-0 achieves the highest mean success rate on both SparkArena tracks and ranks first on all eight aggregate metrics of the Ego Humanoid Manipulation Benchmark.
  • Against vision-only pretraining on the same data and compute with touch discarded, retaining the touch of 1,000 hours of HumanTouch raises vision-only success on Ego Humanoid from 52.5% to 71.7%.
  • On SparkArena-Real, where touch is also used at deployment, success rises from 44.0% to 52.0%.

Limitations

The abstract does not detail the tactile hardware, the calibration error between gloves and robot hands, or the mechanism by which contact-map supervision shapes visual tokens. The real-robot track is small (a single dexterous embodiment), and cross-embodiment or cross-sensor transfer is untested. Collecting 1,000 hours of human tactile data is also expensive, setting a high bar for reproduction.

Industry Implications

The most valuable claim here is that touch is not only a policy input but a scalable pretraining supervision signal. That changes the data economics of tactile sensing: teams can improve vision-only policies with human tactile data without fitting tactile hardware on every robot hand. For groups held back by the cost of tactile deployment, this is a clear signal that the value of tactile data may be realized before the hardware. The public dataset and benchmark also give the long-running “how much is touch worth” debate a comparable yardstick for the first time.