Exploring Moral Exercises for Human Oversight of AI systems: Insights from Three Pilot Studies

2025-05-20

AI Summary

AI systems face a critical gap in effective human oversight, undermining ethical accountability. Method: This study proposes a virtue-centered moral training framework, empirically developed through three cross-contextual pilots—industry practitioners, interdisciplinary research teams, and university students—employing participatory action research, reflective workshops, and narrative analysis. Contribution/Results: It introduces the first integrated “Participatory Character–Relational Understanding–Technomoral Wisdom” triadic framework, bridging classical virtue ethics with contemporary AI governance practice. Empirical findings demonstrate significant improvements in practitioners’ agentic capacity, relational awareness, and technomoral judgment, alongside strengthened organizational responsibility culture. Key implementation barriers—including time constraints and challenges in outcome assessment—were also identified. The study establishes a theoretically grounded yet pragmatically viable methodology and implementation paradigm for building AI ethics competencies.

Technology Category

Philosophy and Ethics of AI: Bias, Fairness & EquityHumans and AI: Learning Human Values and PreferencesNatural Language Processing: Ethics — Bias, Fairness, Transparency & Privacy

Application Category

Responsible Web: Machine-in-the-loop, human agency and autonomyEconomics, Online Markets and Human Computation: Fairness and ethical considerations in crowd work and in human-in-the-loop AI systemsUser Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization

Abstract

This paper elaborates on the concept of moral exercises as a means to help AI actors cultivate virtues that enable effective human oversight of AI systems. We explore the conceptual framework and significance of moral exercises, situating them within the contexts of philosophical discourse, ancient practices, and contemporary AI ethics scholarship. We outline the core pillars of the moral exercises methodology - eliciting an engaged personal disposition, fostering relational understanding, and cultivating technomoral wisdom - and emphasize their relevance to key activities and competencies essential for human oversight of AI systems. Our argument is supported by findings from three pilot studies involving a company, a multidisciplinary team of AI researchers, and higher education students. These studies allow us to explore both the potential and the limitations of moral exercises. Based on the collected data, we offer insights into how moral exercises can foster a responsible AI culture within organizations, and suggest directions for future research.

Problem

• Developing moral exercises for AI human oversight
• Exploring virtues for effective AI system governance
• Assessing moral exercises' impact on AI ethics culture

Innovation

• Moral exercises cultivate virtues for AI oversight
• Framework includes personal, relational, and wisdom pillars
• Pilot studies test exercises in diverse settings