Exploring a New Competency Modeling Process with Large Language Models

📅 2026-02-13
📈 Citations: 0
Influential: 0
📄 PDF

career value

192K/year

Technology Category

Application Category

📝 Abstract
Competency modeling is widely used in human resource management to select, develop, and evaluate talent. However, traditional expert-driven approaches rely heavily on manual analysis of large volumes of interview transcripts, making them costly and prone to randomness, ambiguity, and limited reproducibility. This study proposes a new competency modeling process built on large language models (LLMs). Instead of merely automating isolated steps, we reconstruct the workflow by decomposing expert practices into structured computational components. Specifically, we leverage LLMs to extract behavioral and psychological descriptions from raw textual data and map them to predefined competency libraries through embedding-based similarity. We further introduce a learnable parameter that adaptively integrates different information sources, enabling the model to determine the relative importance of behavioral and psychological signals. To address the long-standing challenge of validation, we develop an offline evaluation procedure that allows systematic model selection without requiring additional large-scale data collection. Empirical results from a real-world implementation in a software outsourcing company demonstrate strong predictive validity, cross-library consistency, and structural robustness. Overall, our framework transforms competency modeling from a largely qualitative and expert-dependent practice into a transparent, data-driven, and evaluable analytical process.
Problem

Research questions and friction points this paper is trying to address.

competency modeling
large language models
human resource management
behavioral analysis
model validation
Innovation

Methods, ideas, or system contributions that make the work stand out.

Large Language Models
Competency Modeling
Embedding-based Similarity
Learnable Fusion Parameter
Offline Evaluation
🔎 Similar Papers
No similar papers found.
S
Silin Du
School of Economics and Management, Tsinghua University, Beijing, China
M
Manqing Xin
School of Economics and Management, Tsinghua University, Beijing, China
R
Raymond Jia Wang
Bill-JC Technology, Wuhan, China