Role of CI Adoption in Mobile App Success: An Empirical Study of Open-Source Android Projects

2026-02-02

AI Summary

This study addresses the lack of empirical evidence on the real-world impact of Continuous Integration (CI) in mobile application development, particularly concerning app store performance. Leveraging a large-scale dataset of open-source Android projects, we systematically compare CI adopters and non-adopters through time-series analysis to assess CI’s effects on development activity, bug-fixing efficiency, release frequency, and user engagement metrics on Google Play—specifically downloads and review counts. Our findings reveal, for the first time, distinct adoption patterns of CI in the mobile ecosystem: CI is predominantly adopted by larger, more active projects in finance and productivity categories, which exhibit higher release frequencies and significantly greater downloads and reviews, while maintaining stable ratings. This work fills a critical gap in empirical research on CI effectiveness within mobile development contexts.

Technology Category

• Application Domains: Mobility, Driving & Flight
• Search and Optimization: Applications
• Cognitive Modeling & Cognitive Systems: Applications

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Web performance, measurement, and characterization
• Security and Privacy: Large-scale security measurements
• User Modeling, Personalization and Recommendation: Metrics for user behavior and evaluating success

Abstract

Mobile apps face strong pressure for fast and reliable updates. Continuous Integration (CI) helps automate builds, tests, and releases, but its impact on mobile development remains underexplored. Despite the widespread use of CI, little is known about how it affects development activity, release speed, and user-facing outcomes in mobile projects. Existing studies mostly focus on CI adoption in general-purpose software, providing limited insight into mobile-specific dynamics, such as app store visibility and user engagement. In this paper, we analyze open-source Android apps to (1) compare CI adopters and non-adopters, (2) characterize adoption patterns using activity and bug metrics, and (3) assess pre/post adoption changes and user-facing outcomes. We observe that CI adopters are larger and more active, with faster and more regular releases. CI adoption is concentrated in integration- and reliability-intensive categories (e.g., finance and productivity) and is associated with higher Google Play Store engagement (more downloads and reviews) without lower ratings. Overall, CI adoption aligns with practices that support sustained delivery, higher project visibility, and stronger user engagement in mobile ecosystems.

Problem

• Continuous Integration
• Mobile App Development
• Release Speed
• User Engagement
• App Store Visibility

Innovation

• Continuous Integration
• Mobile App Development
• Empirical Study
• User Engagement
• Android