Human Response to Decision Support in Face Matching: The Influence of Task Difficulty and Machine Accuracy

2025-05-19

AI Summary

This study investigates how AI decision-support systems affect human accuracy in face-matching tasks, focusing on the interaction between task difficulty and system accuracy. Method: We conducted a behavioral experiment manipulating task difficulty gradients and AI system accuracy levels, complemented by human factors assessments and mixed-effects logistic regression modeling. Contribution/Results: High task difficulty reduced human matching accuracy by 32% and critically impaired participants’ ability to discern correct from incorrect AI suggestions—approaching chance-level discrimination. We identify for the first time a “difficulty–trust decoupling” phenomenon: under high difficulty, humans maintain unwarranted trust in AI, leading to increased erroneous adoption of AI recommendations. These findings challenge the prevailing assumption that higher AI accuracy inherently enhances human–AI collaborative performance. They reveal critical cognitive constraints for trustworthy AI design and provide empirically grounded human-centered optimization pathways for AI-assisted decision-making systems.

Technology Category

• Humans and AI: Planning and Decision Support for Human-Machine Teams
• Cognitive Modeling & Cognitive Systems: Simulating Human Behavior
• Philosophy and Ethics of AI: Safety, Robustness & Trustworthiness

Application Category

• Economics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI
• Responsible Web: Machine-in-the-loop, human agency and autonomy
• User Modeling, Personalization and Recommendation: Fairness-aware retrieval and ranking

Abstract

Decision support systems enhanced by Artificial Intelligence (AI) are increasingly being used in high-stakes scenarios where errors or biased outcomes can have significant consequences. In this work, we explore the conditions under which AI-based decision support systems affect the decision accuracy of humans involved in face matching tasks. Previous work suggests that this largely depends on various factors, such as the specific nature of the task and how users perceive the quality of the decision support, among others. Hence, we conduct extensive experiments to examine how both task difficulty and the precision of the system influence human outcomes. Our results show a strong influence of task difficulty, which not only makes humans less precise but also less capable of determining whether the decision support system is yielding accurate suggestions or not. This has implications for the design of decision support systems, and calls for a careful examination of the context in which they are deployed and on how they are perceived by users.

Problem

• How task difficulty affects human accuracy in face matching
• Impact of machine precision on human decision-making in face matching
• Human ability to judge AI decision support system accuracy

Innovation

• AI-based decision support for face matching
• Examining task difficulty and system precision
• Human accuracy influenced by support perception