🤖 AI Summary
Bootstrapping on massive datasets faces bottlenecks including high computational cost, substantial distributed communication overhead, and memory constraints. To address these challenges, this paper proposes an MPI-based scalable parallel bootstrapping algorithm. Its key contributions are: (1) a local sufficient statistic aggregation mechanism that drastically reduces inter-node communication volume; (2) a synchronized pseudorandom number generation strategy that eliminates the need for storing massive intermediate resampling data, thereby alleviating memory pressure; and (3) rigorous theoretical modeling of communication and computational complexity to ensure scalability. Experimental results demonstrate that the method maintains statistical consistency while significantly reducing both communication overhead and memory footprint. It substantially outperforms naive parallel baselines and is well-suited for ultra-large-scale data analytics.
📝 Abstract
Bootstrapping is a powerful statistical resampling technique for estimating the sampling distribution of an estimator. However, its computational cost becomes prohibitive for large datasets or a high number of resamples. This paper presents a theoretical analysis and design of parallel bootstrapping algorithms using the Message Passing Interface (MPI). We address two key challenges: high communication overhead and memory constraints in distributed environments. We propose two novel strategies: 1) Local Statistic Aggregation, which drastically reduces communication by transmitting sufficient statistics instead of full resampled datasets, and 2) Synchronized Pseudo-Random Number Generation, which enables distributed resampling when the entire dataset cannot be stored on a single process. We develop analytical models for communication and computation complexity, comparing our methods against naive baseline approaches. Our analysis demonstrates that the proposed methods offer significant reductions in communication volume and memory usage, facilitating scalable parallel bootstrapping on large-scale systems.