quality assurance

Designs and implements processes, test strategies, and measurement systems that ensure products, services, or processes meet defined quality criteria and compliance requirements. Builds test plans and cases, develops and operates manual and automated test suites, defines acceptance criteria and quality metrics, performs audits and root-cause analysis, and integrates quality controls into development and delivery workflows to detect, prevent, and drive continuous improvement.

qualityassurance

Recent Skill Trend

Momentum and market value over time
Trending
Score
No comparison yet
-1.46
Oct 01, 2026Oct 01, 2026
Career
Value
No comparison yet
$193K/year
Oct 01, 2026Oct 01, 2026

Recommended Survey Paper

Quick overview of the field
View more

Must-Read Papers

Most classic and influential ideas
View more

Automating Execution and Verification of BPMN+DMN Business Processes

Dec 17, 2025
GD
Giuseppe Della Penna
🏛️ University of L'Aquila

Existing BPMN+DMN process models lack semantic-level automated verification; mainstream tools support only syntactic validation, while behavioral errors require manual execution and debugging, and model transformations remain opaque. Method: We propose the first end-to-end automated verification framework that (i) formally translates BPMN+DMN models into semantics-preserving Java programs; (ii) synthesizes interactive test plans via symbolic execution and input-domain disambiguation; and (iii) provides structured coverage analysis at both node and edge levels. Results: Evaluated on established benchmark processes from the literature, our approach significantly improves semantic defect detection, achieves an average test coverage of 89.3%, and accelerates verification by over 20× compared to manual methods.

Addressing semantic faults beyond syntactical error detectionAutomating verification of BPMN+DMN business processes correctnessTranslating processes to executable code for systematic testing

Quality attributes of test cases and test suites -- importance & challenges from practitioners' perspectives

Jul 08, 2025
HK
Huynh Khanh Vi Tran
🏛️ Blekinge Institute of Technology | Örebro University

This study investigates the practical prioritization of key quality attributes—such as fault detection capability, usability, and maintainability—in test cases and test suites, along with associated implementation challenges in industrial software testing. We designed a structured questionnaire grounded in a systematic literature review and deployed it across a large-scale, heterogeneous cohort of software testing practitioners on LinkedIn, yielding 354 valid responses. Mixed-method analysis (qualitative and quantitative) revealed significant contextual variations in attribute prioritization across domains—including agile, embedded, and web development—and identified three pervasive barriers: ambiguous attribute definitions, absence of actionable measurement metrics, and lack of formal review mechanisms. To our knowledge, this is the first empirical study to systematically characterize such cross-domain perceptual differences and practical impediments. The findings provide evidence-based guidance for refining test quality assessment frameworks and prioritizing engineering improvements in real-world testing practice.

Identifying challenges in maintaining important test suite attributesProviding support for high-quality test cases in various contextsUnderstanding practitioners' views on test case quality attributes

Tool-Assisted Conformance Checking to Reference Process Models

Aug 01, 2025
BR
Bernhard Rumpe
🏛️ RWTH Aachen University

Existing conformance checking approaches between process models and reference models suffer from limited semantic expressiveness and insufficient automation, hindering fine-grained compliance verification. This paper proposes a semantic consistency checking method grounded in causal dependency analysis of tasks and events, transcending traditional trajectory-based dependency modeling by formally encoding causal constraints at the semantic level. We establish a unified framework integrating causal dependency modeling, semantic representation, and formal verification, and design an automated conformance checking algorithm implemented in a prototype tool. Empirical evaluation demonstrates that our approach significantly outperforms state-of-the-art techniques in both accuracy and flexibility, achieving— for the first time—the fully automated, high-expressivity semantic conformance verification of process models against reference models.

Automated conformance checks for process models against reference modelsEnhancing accuracy and flexibility in process model conformance verificationLack of expressiveness and automation in semantic model comparison

This work addresses the challenge of balancing software quality, testability, and maintainability under rapid iteration and frequent requirement changes. It proposes Algorithm-Driven Development (ADD), a novel approach that unifies requirements specification and technical design by using algorithm flowcharts as a single, coherent artifact. This integration enables end-to-end modeling of requirements, architecture, and testing. Leveraging this model, the system automatically generates high-coverage acceptance tests and incorporates continuous integration with code coverage feedback. Industrial adoption at Dassault Systèmes demonstrates that ADD achieves over 95% code coverage, substantially reduces defect density, and ensures a stable delivery cadence, outperforming conventional test-driven development and test-after approaches.

defect reductionmaintainabilityrequirements translation

Facing persistent declines in customer satisfaction among small- and medium-sized enterprises (SMEs) in the IT services sector—and intensifying competitive pressure from rivals delivering superior service at lower costs—this study proposes an integrated service quality assessment framework combining Lean Six Sigma and the SERVQUAL model. Methodologically, it systematically unifies the DMAIC methodology, SERVQUAL’s five-dimensional gap analysis, and Six Sigma’s data-driven statistical process control techniques to establish a quantifiable, traceable pathway for service improvement. Empirical validation demonstrates that the framework precisely identifies five root causes of customer dissatisfaction, increases customer satisfaction significantly, and reduces customer acquisition cost by 18.3%. This work bridges a critical methodological gap in service quality management: the absence of a quantitatively rigorous, end-to-end integrated approach—from diagnostic assessment to closed-loop optimization. It offers SME IT service providers a novel quality management paradigm that balances theoretical rigor with practical implementability.

Addresses the lack of robust service quality measurement systems causing customer attritionIntegrates Lean Six Sigma with SERVQUAL to identify root causes of dissatisfactionProposes a framework to measure customer satisfaction in computer service companies

Latest Papers

What's happening recently
View more

This study addresses the challenges of implementing technical quality control in agile R&D projects under conditions of high technological uncertainty and experimental pressure. Through a mixed-methods approach combining survey data, quantitative statistical analysis, and qualitative content analysis, it examines the adoption, perceived effectiveness, and key obstacles related to technical quality practices—such as automated testing, code reviews, and continuous integration—among Scrum teams in technology organizations based in Manaus, Brazil. As the first exploratory investigation focused on this regional innovation ecosystem, the research establishes a baseline for understanding technical quality management in agile R&D contexts. It reveals critical issues including inconsistent practice implementation, insufficient monitoring of technical quality metrics, and a lack of effective mechanisms to evaluate technical debt from a business-value perspective.

agile R&Dquality controlScrum

Technique to Baseline QE Artefact Generation Aligned to Quality Metrics

Nov 18, 2025
EF
Eitan Farchi
🏛️ IBM Research | IBM Consulting

This study addresses the uncontrolled quality of quality engineering (QE) artifacts—such as requirements specifications, test cases, and Behavior-Driven Development (BDD) scenarios—automatically generated by large language models (LLMs). We propose an iterative optimization framework integrating forward generation, backward generation, and rubric-guided scoring to enhance artifact quality along four dimensions: clarity, completeness, consistency, and testability. Our approach enables automated, quantitative, and reproducible quality assessment and improvement. Evaluated across 12 real-world projects, the method significantly improves output stability: it preserves high quality under high-quality inputs and substantially outperforms baselines under low-quality inputs. The core contribution is the first integration of backward generation with structured rubric-based guidance, establishing a closed-loop, artifact-centric quality enhancement paradigm for QE.

Ensuring generated requirements and test cases meet quality metricsEstablishing baselines for automated QE artefact quality evaluationValidating LLM outputs through reverse generation and iterative refinement

This work addresses the problem of implementation drift in evolving distributed systems, where runtime behavior gradually deviates from the original design. To tackle this issue, the paper proposes a design conformance assessment method based on distributed tracing data. It introduces, for the first time in the domain of distributed systems, conformance checking techniques from process mining, leveraging runtime traces collected via the OpenTelemetry standard and automatically comparing them against behavioral models defined at design time to quantify their alignment. The key contribution lies in establishing persistent, monitorable conformance metrics that enable continuous, automated evaluation of deviations between system implementation and design. This approach is readily applicable to modern distributed systems widely adopting OpenTelemetry for observability.

design conformancedistributed systemsimplementation drift

DataOps-driven CI/CD for analytics repositories

Nov 15, 2025
DV
Dmytro Valiaiev
🏛️ University of Arkansas Little Rock

Ad hoc SQL development lacks engineering rigor, leading to data silos, logical redundancy, and ineffective data governance. Method: This paper proposes a DataOps-driven CI/CD framework for analytical SQL warehouses, featuring a novel five-stage automated pipeline—Lint, Optimize, Parse, Validate, Observe—that embeds quality assurance and enables end-to-end lifecycle governance. Contribution/Results: We introduce the DataOps Controls Scorecard and a requirements traceability matrix, explicitly mapping 12 governance criteria to CI/CD stages to ensure control completeness and scalability. The framework integrates Agile, Lean, and DevOps principles with static analysis, syntactic parsing, optimization recommendations, validation testing, and observability. Empirical evaluation demonstrates significant improvements in data quality, development transparency, and cross-functional collaboration, providing a sustainable, production-ready pathway for large-scale analytical systems.

Addressing ad-hoc SQL development lacking software engineering rigorProviding standardized DataOps framework for analytics pipeline managementSolving data governance challenges and validation impossibility in analytics

This study addresses the persistent challenge organizations face in aligning DevOps automation initiatives with strategic objectives such as waste reduction, delivery predictability, cross-team collaboration, and customer-perceived quality. To bridge this gap, the authors propose a unified VSM–GQM–DevOps framework that integrates Value Stream Mapping (VSM), the Goal-Question-Metric (GQM) approach, and DevOps practices. The framework enables identification of delivery bottlenecks, construction of decision-oriented measurement models, and implementation of maturity-aligned, reversible automation interventions, thereby establishing an auditable and traceable pathway for automation investment. Validated through a multi-site longitudinal study employing DORA metrics, interrupted time series analysis, and mixed-methods evaluation, the framework demonstrates significant improvements in delivery performance and project management outcomes, fostering continuous, strategy-aligned improvement.

delivery performanceDevOps automationGoal-Question-Metric

Hot Scholars

MY

Min Yang

Bytedance
Vision Language ModelComputer VisionVideo Understanding
YF

Yi-Fan Zhang

Institute of Automation, Chinese Academy of Sciences
Computer VisionMultimodalityAlignmentMachine Learning
CF

Chaoyou Fu

Nanjing University
Multimodal LLMLLMBiometrics
LH

Lei Hou

RMIT University
Building Information Modeling (BIM) - Project Management - Construction IT - Productivity Research - Lean Construction
JL

Juanzi Li

Tsinghua University
Semantic Webdata miningNLP