🤖 AI Summary
To address scalability and collaborative efficiency bottlenecks in storing, indexing, and sharing large-scale unstructured robot data (e.g., ROS bags, MCAP), this paper proposes a modular local-cloud architecture. The architecture integrates S3-compatible object storage, Dockerized processing pipelines, and dual-mode Web/CLI interfaces, introducing the novel “Action Runner” mechanism to automate end-to-end workflows—including data validation, format standardization, metadata indexing, and benchmarking. It enables unified management of heterogeneous robot data formats and has been deployed to reliably host over 30 TB of real-world research data. Empirical evaluation demonstrates significant improvements in data discoverability, reuse rate, and cross-team collaboration. The system establishes a reproducible, scalable infrastructure paradigm for data-intensive robotics research.
📝 Abstract
We introduce Kleinkram, a free and open-source system designed to solve the challenge of managing massive, unstructured robotic datasets. Designed as a modular, on-premises cloud solution, Kleinkram enables scalable storage, indexing, and sharing of datasets, ranging from individual experiments to large-scale research collections. Kleinkram natively integrates with standard formats such as ROS bags and MCAP and utilises S3-compatible storage for flexibility. Beyond storage, Kleinkram features an integrated"Action Runner"that executes customizable Docker-based workflows for data validation, curation, and benchmarking. Kleinkram has successfully managed over 30 TB of data from diverse robotic systems, streamlining the research lifecycle through a modern web interface and a robust Command Line Interface (CLI).