Through the Looking-Glass: Transparency Implications and Challenges in Enterprise AI Knowledge Systems

2026-04-11

AI Summary

This paper addresses sociotechnical challenges of transparency in enterprise AI knowledge systems: transparency not only reshapes employees’ perceptions of their own and others’ contributions but also reconfigures organizational knowledge representation, identity formation, and collaborative relationships. Methodologically, the study develops an original “mirror” theoretical framework that distinguishes two transparency modalities—“looking into the system” (interface visibility) and “looking through the system” (mechanism intelligibility)—and proposes a three-dimensional transparency model spanning system architecture, procedural logic, and outcome articulation. Drawing on conceptual modeling, CSCW principles, and sociotechnical systems analysis, the research identifies three structural barriers impeding transparency implementation and uncovers deep-rooted causes of the AI trust gap. The contribution is a novel, theoretically grounded yet practice-oriented paradigm for explainable AI design and human-AI collaboration in organizational settings.

Technology Category

Computer Vision: Interpretability, Explainability, and TransparencyMachine Learning: Transparent, Interpretable, Explainable MLHumans and AI: Explainable AI (XAI) for Human Understanding

Application Category

Security and Privacy: Data transparency and provenanceUser Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalizationResponsible Web: Algorithmic accountability and transparency on the web

Abstract

Knowledge can't be disentangled from people. As AI knowledge systems mine vast volumes of work-related data, the knowledge that's being extracted and surfaced is intrinsically linked to the people who create and use it. When these systems get embedded in organizational settings, the information that is brought to the foreground and the information that's pushed to the periphery can influence how individuals see each other and how they see themselves at work. In this paper, we present the looking-glass metaphor and use it to conceptualize AI knowledge systems as systems that reflect and distort, expanding our view on transparency requirements, implications and challenges. We formulate transparency as a key mediator in shaping different ways of seeing, including seeing into the system, which unveils its capabilities, limitations and behavior, and seeing through the system, which shapes workers' perceptions of their own contributions and others within the organization. Recognizing the sociotechnical nature of these systems, we identify three transparency dimensions necessary to realize the value of AI knowledge systems, namely system transparency, procedural transparency and transparency of outcomes. We discuss key challenges hindering the implementation of these forms of transparency, bringing to light the wider sociotechnical gap and highlighting directions for future Computer-supported Cooperative Work (CSCW) research.

Problem

• Transparency in AI knowledge systems
• Impact on worker perceptions and identity
• Sociotechnical challenges in system implementation

Innovation

• AI knowledge systems transparency
• looking-glass metaphor conceptualization
• three transparency dimensions