IAPRepair: In-Network Aggregation Enhanced Proactive Repair for Erasure-Coded Storage System

📅 2026-10-07
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This study addresses the receiver-side bottleneck and bandwidth heterogeneity challenges in erasure-coded storage repair. We propose a joint optimization framework that coordinates data migration, reconstruction, and network aggregation to dynamically distribute repair loads. A novel selective in-network aggregation mechanism is designed to accommodate switch resource constraints, reducing receiver traffic while preserving migration parallelism. The proposed approach is prototyped on Tofino programmable switches and validated through large-scale simulations and testbed experiments. Results demonstrate that our method reduces repair time by at least 47.83% compared to state-of-the-art approaches across diverse scenarios, substantially improving repair efficiency in heterogeneous environments.
📝 Abstract
Erasure-coded storage provides fault tolerance with substantially lower storage overhead than full replication, but repairing lost or at-risk blocks requires intensive cross-node data transfer. Existing reactive repair schemes start only after a failure, while proactive schemes can move data before failure but commonly treat migration, reconstruction, and network aggregation as loosely coupled operations. As a result, receiver?side bottlenecks, heterogeneous available bandwidth, and limited programmable-switch state continue to constrain repair paral?lelism. This paper presents IAPRepair, an in-network aggre?gation enhanced proactive repair framework for erasure-coded storage. IAPRepair jointly constructs each repair batch, assigns reconstruction providers and replacement nodes according to normalized transmission loads, schedules migration around the remaining receive capacity, and selectively enables in-network aggregation for reconstruction blocks that would otherwise over?load healthy nodes. The selective design reduces receiver-side traffic while retaining migration parallelism and respecting a configurable switch-resource budget. We implement IAPRepair with a Tofino programmable switch and 16 storage nodes, and evaluate it using both a prototype testbed and large-scale simu?lations. Across coding parameters, block sizes, node populations, and multiple STF-node scenarios, IAPRepair reduces repair time by at least 47.83% compared with the evaluated state-of-the-art methods. The results demonstrate that coordinating proactive repair decisions with in-network processing is an effective way to improve repair efficiency under bandwidth heterogeneity.
Problem

Research questions and friction points this paper is trying to address.

Erasure-coded storage
Proactive repair
In-network aggregation
Receiver-side bottleneck
Bandwidth heterogeneity
Innovation

Methods, ideas, or system contributions that make the work stand out.

In-network aggregation
Proactive repair
Erasure-coded storage
Programmable switch
Bandwidth heterogeneity
🔎 Similar Papers
No similar papers found.
L
Lei Liu
School of Computer Science and Information Security, Guilin University of Electronic Technology, Guilin 541004, China; and also with the School of Computer Science and Engineering, Guilin University of Aerospace Technology, Guilin 541004, China
Yong Wang
Yong Wang
Professor of Computer Science, Ocean University of China
Software EngineeringOperational ResearchMachine Learning
Junqi Chen
Junqi Chen
Northwestern Polytechnical University
Speech recognitionAnomaly detectionTime series analysis
Y
Yangfan Liang
College of Information Science and Engineering, Jiaxing University, Jiaxing 314001, China
Qian He
Qian He
ByteDance
B
Baokang Zhao
College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China