"Why do we do this?": Moral Stress and the Affective Experience of Ethics in Practice

2025-02-25

AI Summary

This study identifies “moral stress”—an unrecognized affective discomfort and vulnerability arising from blurred role boundaries and contested decision authority—as a critical barrier to the operationalization of AI ethics tools within urban technology teams. Employing ethnographic fieldwork, qualitative interviews, and organizational behavior analysis, it introduces the concept of moral stress systematically into AI ethics practice research for the first time. Findings reveal that even under optimal conditions—adequate resources and standardized ethical workflows—existing organizational structures and tool designs fail to mitigate this stress; instead, affective experience emerges as a key mechanism underlying ethical intervention failure. The study thus extends AI ethics theory by foregrounding emotion as a constitutive dimension of ethical practice, and proposes a concrete pathway: redesigning ethics tools and organizational support systems with affective sensitivity. This reframing offers both a critical caution and empirically grounded design principles for enhancing the real-world efficacy of AI ethics implementation.

Technology Category

• Philosophy and Ethics of AI: Bias, Fairness & Equity
• Natural Language Processing: Ethics — Bias, Fairness, Transparency & Privacy
• Machine Learning: Ethics, Bias, and Fairness

Application Category

• Economics, Online Markets and Human Computation: Fairness and ethical considerations in crowd work and in human-in-the-loop AI systems
• User Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization
• Semantics and Knowledge: Provenance, trust, security and privacy, and ethical issues in managing semantic data

Abstract

A plethora of toolkits, checklists, and workshops have been developed to bridge the well-documented gap between AI ethics principles and practice. Yet little is known about effects of such interventions on practitioners. We conducted an ethnographic investigation in a major European city organization that developed and works to integrate an ethics toolkit into city operations. We find that the integration of ethics tools by technical teams destabilises their boundaries, roles, and mandates around responsibilities and decisions. This lead to emotional discomfort and feelings of vulnerability, which neither toolkit designers nor the organization had accounted for. We leverage the concept of moral stress to argue that this affective experience is a core challenge to the successful integration of ethics tools in technical practice. Even in this best case scenario, organisational structures were not able to deal with moral stress that resulted from attempts to implement responsible technology development practices.

Problem

• Moral stress in AI ethics
• Affective experience challenges
• Organizational integration issues

Innovation

• Ethnographic investigation of ethics toolkit integration
• Moral stress affects responsible technology development
• Organizational challenges in ethics tool implementation