RoboTok: internet-scale retrieval of human demonstrations for dexterous robot policies

Research official 2 src. ~1 min

RoboTok is a data engine that, given a query manipulation video, retrieves relevant human demonstrations from web video for training dexterous robot policies. It learns a latent motion space from 3D hand trajectories in actor-centered frames, making retrieval robust to camera viewpoint, scene appearance and occlusion while remaining searchable at internet scale.

Why it matters

Over 100 upvotes on HF Daily Papers (115) — targets the core bottleneck of robot learning: cheap, diverse, long-tail training data.

Importance: 3/5

HF Daily Papers >=100 upvotes (115)

robotics retrieval manipulation data

Sources

official RoboTok: An Internet-Scale Data Engine for Human Demonstration Retrieval and Dexterous Manipulation Learning (arXiv)

secondary RoboTok — Hugging Face Daily Papers (syndicated from arXiv)