Beyond Community Notes: A Framework for Understanding and Building Crowdsourced Context Systems

2025-09-18

AI Summary

Contemporary crowdsourced contextualization systems (CCS)—such as Community Notes—lack a systematic theoretical framework to understand their information governance mechanisms. This paper formally defines CCS and constructs a six-dimensional design space encompassing participation, input, review, presentation, platform processing, and transparency. We integrate theoretical modeling, a systematic literature review, multi-case empirical analysis, and normative ethical evaluation. Our findings reveal how specific design choices critically affect information credibility, propagation bias, and public trust. Based on these insights, we propose human-centered design principles for CCS. The study advances foundational theory and practical guidance for transparent governance, algorithmic accountability, and democratic content interpretation in CCS.

Technology Category

• Humans and AI: Crowd Sourcing and Human Computation
• Cognitive Modeling & Cognitive Systems: Social Cognition And Interaction
• Application Domains: Humanities & Computational Social Science

Application Category

• User Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization
• Security and Privacy: Data transparency and provenance
• Economics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI

Abstract

Social media platforms are increasingly developing features that display crowdsourced context alongside posts, modeled after X's Community Notes. These systems, which we term Crowdsourced Context Systems (CCS), have the potential to reshape our information ecosystem as major platforms embrace them as alternatives to top-down fact-checking. To deeply understand the features and implications of such systems, we perform a systematic literature review of existing CCS research and analyze several real-world CSS implementations. Based on our analysis, we develop a framework with three distinct components. First, we present a theoretical model to help conceptualize and define CCS. Second, we identify a design space encompassing six key aspects of CCS: participation, inputs, curation, presentation, platform treatment, and transparency. Third, we identify key normative implications of different CCS design and implementation choices. Our framework integrates these theoretical, design, and ethical perspectives to establish a foundation for future human-centered research on Crowdsourced Context Systems.

Problem

• Understanding features and implications of crowdsourced context systems
• Developing a theoretical model to conceptualize Crowdsourced Context Systems
• Identifying design space and normative implications for CCS implementation

Innovation

• Systematic literature review of existing CCS research
• Developed framework with theoretical model and design space
• Identified normative implications of CCS design choices