Strawberry Robotic Operation Interface: An Open-Source Device for Collecting Dexterous Manipulation Data in Robotic Strawberry Farming

📅 2025-01-28
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
Strawberry harvesting faces challenges in occluded object detection, labor-intensive dexterous manipulation, and scarcity of high-quality agricultural robotics data. Method: This work introduces the open-source Strawberry Robot Operation Interface (SROI), a handheld robotic platform integrating modular end-effectors and a stereo camera for eye-in-hand operation in dynamic field environments. It features a lightweight, deployable open-hardware architecture and establishes a dedicated post-processing pipeline for dexterous manipulation data. Contribution/Results: We release the first open-source, high-fidelity strawberry harvesting dataset with multimodal annotations—including 3D spatial trajectories, gripper state sequences, and synchronized visual frames—enabling rigorous benchmarking. The SROI significantly lowers the barrier to collecting dexterous manipulation data in agriculture, providing foundational resources for algorithm development, model training, and system validation in agri-robotics.

Technology Category

Application Category

📝 Abstract
The strawberry farming is labor-intensive, particularly in tasks requiring dexterous manipulation such as picking occluded strawberries. To address this challenge, we present the Strawberry Robotic Operation Interface (SROI), an open-source device designed for collecting dexterous manipulation data in robotic strawberry farming. The SROI features a handheld unit with a modular end effector, a stereo robotic camera, enabling the easy collection of demonstration data in field environments. A data post-processing pipeline is introduced to extract spatial trajectories and gripper states from the collected data. Additionally, we release an open-source dataset of strawberry picking demonstrations to facilitate research in dexterous robotic manipulation. The SROI represents a step toward automating complex strawberry farming tasks, reducing reliance on manual labor.
Problem

Research questions and friction points this paper is trying to address.

Strawberry Harvesting
Manual Labor Shortage
Robotic Dexterity Challenge
Innovation

Methods, ideas, or system contributions that make the work stand out.

Strawberry Robotic Operation Interface (SROI)
3D Vision Capability
Collective Advancement in Agricultural Robotics
L
Linsheng Hou
ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou, 311215, China
W
Wenwu Lu
ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou, 311215, China
Y
Yanan Wang
College of Biosystems Engineering and Food Science, Zhejiang University, Hangzhou, 310058, China
Chen Peng
Chen Peng
Zhejiang University
RoboticsPath planning and control
Zhenghao Fei
Zhenghao Fei
Zhejiang University, ZJU-Hangzhou Global Scientific and Technological Innovation Center
Agricultural Automation