Individuals, Crowds, and the Network Dynamics of Belief Accuracy

2024-06-28

AI Summary

This paper investigates the mechanisms through which interpersonal communication affects the accuracy of numerical estimates. Methodologically, it integrates opinion dynamics modeling, social network analysis, and error variance decomposition theory to formally decompose aggregate estimation error change into three distinct components: network centralization, calibration (the correlation between individual accuracy and influence), and conformity (the correlation between influence and proximity to the group mean). Empirical validation across six controlled experiments reveals that while individual estimation errors consistently improve, collective errors often deteriorate due to excessive conformity or structural network biases. Theoretically, we prove that individual-level error reduction strictly dominates aggregate-level improvement—the difference equals the change in estimation variance. Our primary contribution is uncovering the divergence mechanism of belief accuracy between individual and collective levels, and proposing a decomposable, empirically testable analytical framework for quantifying social influence on estimation precision.

Technology Category

• Cognitive Modeling & Cognitive Systems: Social Cognition And Interaction
• Reasoning under Uncertainty: Other Foundations of Reasoning under Uncertainty
• Machine Learning: Calibration & Uncertainty Quantification

Application Category

• Social Networks and Social Media: Influence propagation, information diffusion, and the prediction on networks
• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Security and Privacy: Large-scale security measurements

Abstract

Does talking to others make people more accurate or less accurate on numeric estimates such as quantitative evaluations or probabilistic forecasts? Research on peer-to-peer communication suggests that discussion between people will usually improve belief accuracy, while research on social networks suggests that error can percolate through groups and reduce accuracy. One challenge to interpreting empirical literature is that some studies measure accuracy at the group level, while others measure individual accuracy. We explain how social influence impacts belief accuracy by analyzing a formal model of opinion formation to identify the relationship between individual accuracy, group accuracy, and the network dynamics of belief formation. When opinions become more similar over time, change in individual error is always strictly better than change in group error, by a value equal to the change in variance. We show that change in group error can be decomposed into the influence network centralization, the accuracy/influence correlation ("calibration"), and the averageness/influence correlation ("herding"). Because group dynamics both theoretically and empirically lead people to become more similar over time, one might intuitively expect that the same factors which reduce group accuracy will also reduce individual accuracy. Instead, we find that individuals reliably improve under nearly all conditions, even when groups get worse. We support this analysis with data from six previously published experiments.

Problem

• Impact of social influence on belief accuracy in networks
• Relationship between individual and group accuracy dynamics
• Conditions under which individuals improve accuracy despite group decline

Innovation

• Analyzes network dynamics of belief formation
• Decomposes group error into influence factors
• Shows individuals improve despite group inaccuracy