Survey Experience and Nonresponse in an Online Probability Panel: A Survival Analysis

📅 2025-05-06
📈 Citations: 0
✨ Influential: 0
📄 PDF
🤖 AI Summary
This study investigates how respondents’ prior survey experiences in online probability panels influence subsequent response behavior, aiming to reduce nonresponse and panel attrition. Using longitudinal panel data, it is the first to systematically apply discrete-time survival analysis to nonresponse modeling—effectively accommodating unbalanced panel structures—while integrating dynamic effects of multi-wave survey experiences (e.g., duration, perceived enjoyment, mode—telephone vs. web—and inter-wave interval) and stable individual traits (e.g., conscientiousness, openness). Results indicate that longer survey duration, lower enjoyment ratings, telephone administration, and extended inter-wave intervals significantly increase refusal risk; conversely, personality traits exhibit robust cross-wave predictive power for response propensity. The findings advance theoretical understanding of panel engagement dynamics and provide empirically grounded, actionable insights for optimizing panel management strategies and enhancing data quality in longitudinal survey research.

Technology Category

Knowledge Representation and Reasoning: PreferencesReasoning under Uncertainty: CausalityHumans and AI: User Experience and Usability

Application Category

User Modeling, Personalization and Recommendation: Studies of user behavior, including longitudinal effects of personalized systemsResponsible Web: Social and technical mechanisms of refusal for web technologies and applicationsEconomics, Online Markets and Human Computation: Sustainability of Web economics
📝 Abstract
We fit discrete time survival models to data from an online probability panel, where the outcome is the respondent first nonresponse to a survey invitation, following at least one previous survey completion. This approach has the advantage of utilising information about survey experiences over multiple survey waves, while accommodating the unbalanced data structure typical of OPPs, where the number, timing and content of survey invitations varies widely between panel members. We show that the nature and quality of previous survey experience has a strong influence on the propensity to respond to the next survey invitation. Longer surveys, reporting a survey as less enjoyable, a phone interview, and more days since the last survey invitation are found to be important predictors of nonresponse. We also find strong effects of personality on response propensity across survey invitations. Our findings have important implications for survey designers wishing to minimise nonresponse and attrition from OPPs.
Problem

Research questions and friction points this paper is trying to address.

Analyzes survey nonresponse in online probability panels
Examines impact of survey experience on response propensity
Identifies predictors of nonresponse like survey length and enjoyment
Innovation

Methods, ideas, or system contributions that make the work stand out.

Discrete time survival models analyze survey nonresponse
Utilizes multi-wave survey experience data effectively
Identifies key predictors like survey length and enjoyment
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.
K
Katya Kostadintcheva
Department of Methodology, London School of Economics
J
J. Kuha
Department of Methodology, London School of Economics
P
Patrick Sturgis
Department of Methodology, London School of Economics