YUBI: Yielding Universal Bidigital Interface for Bimanual Dexterous Manipulation at Scale

📅 2026-06-08
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This work addresses the poor ergonomics and low trajectory fidelity of conventional handheld teleoperation devices in bimanual dexterous manipulation. The authors propose YUBI, a compliant two-finger interface that leverages a soft finger actuation mechanism to achieve high-fidelity mapping of human hand motions onto a gripper, integrated with VR for six-degree-of-freedom trajectory capture. The study introduces a novel, finger-aligned universal gripper design paradigm, enabling plug-and-play policy transfer across multiple robotic platforms—including UR, Franka, and ELEY. A large-scale bimanual manipulation dataset is released, comprising 119 tasks, 1.2 million trajectories (8,434 hours), with full open-source availability of hardware, software, and data, significantly enhancing robotic dexterity and generalization capabilities.
📝 Abstract
We introduce Yielding Universal Bidigital Interface (YUBI), a finger-aligned gripper designed to enable intuitive, ergonomic, and scalable data collection for bimanual dexterous manipulation. While handheld data collection systems such as Universal Manipulation Interface (UMI) enable affordable data collection, their bulky pistol-grip designs can pose ergonomic and usability challenges for fine-grained, dexterous manipulation tasks. To address this, YUBI presents a distinct design principle: yielding, finger-driven actuation that directly maps human finger movements to gripper jaw motion. Using the YUBI devices, we set up a data collection system with integrated VR-based 6 DoF tracking of the gripper, ensuring high-fidelity trajectory data acquisition. We curate a UMI-based dataset of unprecedented scale: 8,434 hours across 1.20M episodes and 119 tasks. Experiments show that YUBI offers advantages over the UMI gripper in versatility for complex bimanual tasks, dexterity, and operational efficiency. A single policy trained on the YUBI dataset transfers across multiple bimanual robots (UR, Franka, and ELEY) simply by mounting the gripper on each platform, confirming that the collected data are directly executable as policy supervision. We release the gripper hardware, data-collection software, and dataset as one integrated stack, offering the open community a reproducible path to large-scale data acquisition for advancing robotic foundation models.
Problem

Research questions and friction points this paper is trying to address.

bimanual dexterous manipulation
data collection
ergonomic interface
scalable robotics
gripper design
Innovation

Methods, ideas, or system contributions that make the work stand out.

YUBI
bimanual dexterous manipulation
finger-driven actuation
scalable data collection
policy transfer
🔎 Similar Papers
No similar papers found.
Takehiko Ohkawa
Takehiko Ohkawa
University of Tokyo
Computer VisionMachine Learning
J
Jumpei Arima
Toyota Motor Corporation
Y
Yuki Noguchi
Toyota Motor Corporation
M
Masatoshi Tateno
AI Robot Association (AIRoA), The University of Tokyo
M
Makoto Sugiura
AI Robot Association (AIRoA)
T
Takuya Okubo
AI Robot Association (AIRoA)
K
Kengo Ikeuchi
AI Robot Association (AIRoA), The University of Tokyo
Y
Yuma Shin
AI Robot Association (AIRoA), Institute of Science Tokyo
H
Hiroki Nishizawa
AI Robot Association (AIRoA), Waseda University
Naoaki Kanazawa
Naoaki Kanazawa
The University of Tokyo
Robotics
Y
Yuki Wakayama
Toyota Motor Corporation
D
Daiki Fukunaga
Toyota Motor Corporation
Koshi Makihara
Koshi Makihara
AIST
Tomohiro Motoda
Tomohiro Motoda
National Institute of Advanced Industrial Science and Technology (AIST)
Robotic manipulationdeep learning
Floris Erich
Floris Erich
National Institute of Advanced Industrial Science and Technology (AIST, Japan)
Software engineeringartificial intelligenceroboticsmachine learning
Yukiyasu Domae
Yukiyasu Domae
AIST
Machine visionManipulationAutomationExperiential autonomy
Tatsuya Matsushima
Tatsuya Matsushima
The University of Tokyo
Deep LearningArtificial IntelligenceMachine LearningReinforcement LearningRobotics
Y
Yohishiro Okumatsu
Toyota Motor Corporation
Kei Ota
Kei Ota
AIRoA
RoboticsReinforcement Learning