Assessing Problem-Solving in HR Contexts: A Comparison Between Game-Based and Self-Report Measures

2026-02-05

AI Summary

This study investigates the convergence and complementarity between gamified assessments and self-report questionnaires in measuring problem-solving ability. Employing a method-comparison design, 78 participants completed both a five-minute gamified task and the Problem-Solving Inventory–Brief (PSI-B). Behavioral performance was systematically analyzed through behavioral coding and a four-level proficiency classification, enabling a detailed examination of the relationship between observed behaviors and self-perceived competence. Results revealed no significant correlation between self-reported scores and behavioral indicators, providing the first empirical evidence that these two approaches yield complementary—rather than interchangeable—information. These findings underscore the necessity of multimodal assessment strategies in talent selection and challenge the limitations inherent in relying solely on a single assessment modality.

Technology Category

• Game Theory and Economic Paradigms: Behavioral Game Theory
• Cognitive Modeling & Cognitive Systems: Adaptive Behavior
• Humans and AI: Game Design — Procedural Content Generation & Storytelling

Application Category

• User Modeling, Personalization and Recommendation: Metrics for user behavior and evaluating success
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Economics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI

Abstract

Game-based assessments (GBAs) are increasingly adopted in recruitment contexts as tools to assess transversal skills through observable behavior. However, empirical evidence directly comparing game-based behavioral indicators with traditional self-report measures remains limited. This study adopts a method-comparison approach to explore the convergence between self-perceived and behaviorally enacted problem-solving competence, comparing a game-based assessment with the Problem Solving Inventory (PSI-B). Seventy-eight participants completed both the PSI-B and a five-minute game-based problem-solving task, which classified performance into four behavioral proficiency levels. Results revealed no significant convergence between self-reported and behavior-based problem-solving scores, indicating a lack of convergence between the two measurement modalities. Rather than indicating a lack of validity of the game-based assessment, these findings support the view that self-report and behavioral measures provide complementary information about problem-solving competence. The study highlights the risks of relying on a single assessment modality in personnel selection and underscores the value of integrating game-based tools within multi-method assessment frameworks.

Problem

• problem-solving
• game-based assessment
• self-report measures
• method comparison
• personnel selection

Innovation

• game-based assessment
• problem-solving competence
• method-comparison
• behavioral indicators
• self-report measures