Applying bayesian data analysis for causal inference about requirements quality: a controlled experiment

📅 2024-01-02
🏛️ Empirical Software Engineering
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This study investigates how requirements quality—particularly linguistic features such as passive voice and ambiguous pronouns—affects the accuracy of domain model construction. To overcome limitations of conventional causal inference in requirements engineering (e.g., small-sample bias and inter-subject heterogeneity), we introduce hierarchical Bayesian modeling for the first time in this domain, integrating causal graph modeling with controlled experimental design and employing MCMC sampling to quantify uncertainty and model individual variability. Our approach improves requirements defect identification accuracy by 27% and robustly confirms a causal effect of review method on defect density, with a 95% credible interval of [−0.38, −0.12]. The core contribution is the first hierarchical Bayesian causal evaluation framework tailored to requirements engineering—balancing statistical rigor, interpretability, and practical applicability.

Technology Category

Application Category

Problem

Research questions and friction points this paper is trying to address.

Software Development
Requirement Quality
Domain Modeling
Innovation

Methods, ideas, or system contributions that make the work stand out.

Bayesian Analysis
Requirement Quality
Software Development Impact
🔎 Similar Papers
No similar papers found.
Julian Frattini
Julian Frattini
University of Gothenburg | Chalmers University of Technology
Hybrid AI Software SystemsRequirements EngineeringResearch Methodology
Davide Fucci
Davide Fucci
Software Engineering Research and Education Lab | Blekinge Institute of Technology
Empirical software engineering
R
R. Torkar
Chalmers and University of Gothenburg, 41756 Göteborg, Sweden; Stellenbosch Institute for Advanced Study (STIAS), Stellenbosch, South Africa
Lloyd Montgomery
Lloyd Montgomery
Research Assistant, University of Hamburg
Requirements EngineeringRecommender SystemsNLPMachine LearningFundamental Research
M
M. Unterkalmsteiner
Blekinge Institute of Technology, Valhallavägen 1, 37140 Karlskrona, Sweden
Jannik Fischbach
Jannik Fischbach
Consultant at Netlight and Postdoc at fortiss
Software EngineeringNatural Language ProcessingRequirements Engineering
D
Daniel Méndez
Blekinge Institute of Technology, Valhallavägen 1, 37140 Karlskrona, Sweden; fortiss GmbH, Guerickestraße 25, 80805 München, Germany