🤖 AI Summary
Strawberry harvesting faces challenges in occluded object detection, labor-intensive dexterous manipulation, and scarcity of high-quality agricultural robotics data. Method: This work introduces the open-source Strawberry Robot Operation Interface (SROI), a handheld robotic platform integrating modular end-effectors and a stereo camera for eye-in-hand operation in dynamic field environments. It features a lightweight, deployable open-hardware architecture and establishes a dedicated post-processing pipeline for dexterous manipulation data. Contribution/Results: We release the first open-source, high-fidelity strawberry harvesting dataset with multimodal annotations—including 3D spatial trajectories, gripper state sequences, and synchronized visual frames—enabling rigorous benchmarking. The SROI significantly lowers the barrier to collecting dexterous manipulation data in agriculture, providing foundational resources for algorithm development, model training, and system validation in agri-robotics.
📝 Abstract
The strawberry farming is labor-intensive, particularly in tasks requiring dexterous manipulation such as picking occluded strawberries. To address this challenge, we present the Strawberry Robotic Operation Interface (SROI), an open-source device designed for collecting dexterous manipulation data in robotic strawberry farming. The SROI features a handheld unit with a modular end effector, a stereo robotic camera, enabling the easy collection of demonstration data in field environments. A data post-processing pipeline is introduced to extract spatial trajectories and gripper states from the collected data. Additionally, we release an open-source dataset of strawberry picking demonstrations to facilitate research in dexterous robotic manipulation. The SROI represents a step toward automating complex strawberry farming tasks, reducing reliance on manual labor.