Cognitive Affordances in Visualization: Related Constructs, Design Factors, and Framework

2025-09-11

AI Summary

Existing visualization research lacks a systematic cognitive-level framework incorporating affordance theory, hindering explanation of how design choices and reader characteristics jointly shape the hierarchical structure of information communication. Method: This paper introduces the first theoretical framework of *visual cognitive affordance*, integrating insights from psychology, human-computer interaction, and visualization. It formally defines core constructs—perceptual, interpretive, and action affordances—and employs interdisciplinary theoretical synthesis and modeling to derive actionable design evaluation principles. Contribution/Results: The framework is empirically validated through representative visualization case studies, demonstrating its efficacy in optimizing information hierarchy representation and enhancing user comprehension efficiency. It provides both theoretical grounding and practical guidance for visualization design, thereby filling a critical formalization gap in applying affordance theory to the cognitive dimension of visualization.

Technology Category

• Computer Vision: Visual Reasoning & Symbolic Representations
• Cognitive Modeling & Cognitive Systems: Conceptual Inference and Reasoning
• Knowledge Representation and Reasoning: Preferences

Application Category

• Web Mining and Content Analysis: Web data visualization
• User Modeling, Personalization and Recommendation: Personalized content ranking and presentation
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions

Abstract

Classically, affordance research investigates how the shape of objects communicates actions to potential users. Cognitive affordances, a subset of this research, characterize how the design of objects influences cognitive actions, such as information processing. Within visualization, cognitive affordances inform how graphs' design decisions communicate information to their readers. Although several related concepts exist in visualization, a formal translation of affordance theory to visualization is still lacking. In this paper, we review and translate affordance theory to visualization by formalizing how cognitive affordances operate within a visualization context. We also review common methods and terms, and compare related constructs to cognitive affordances in visualization. Based on a synthesis of research from psychology, human computer interaction, and visualization, we propose a framework of cognitive affordances in visualization that enumerates design decisions and reader characteristics that influence a visualization's hierarchy of communicated information. Finally, we demonstrate how this framework can guide the evaluation and redesign of visualizations.

Problem

• Formalizing cognitive affordances theory for visualization contexts
• Lacking translation of affordance concepts to visualization research
• Proposing framework linking design decisions to information communication

Innovation

• Framework for cognitive affordances in visualization
• Design decisions influence information hierarchy
• Guides evaluation and redesign of visualizations