Problem
Research questions and friction points this paper is trying to address.
metamorphic testing
query-based systems
oracle problem
metamorphic relations
software testing
Input Relation Prompting for Metamorphic Testing on Query-Based Systems
🤖 AI Summary
This work addresses the challenge of validating query-based systems, which often lack oracle outputs, and overcomes the inefficiency of traditional manual testing. The authors propose a metamorphic testing approach enhanced with a relational prompting mechanism that automatically derives metamorphic relations by uncovering semantic dependencies among inputs, eliminating the need for predefined test cases or ground-truth outputs. By introducing relational prompting into metamorphic testing for the first time, the method substantially reduces reliance on domain-specific knowledge and integrates effectively with complementary techniques such as combinatorial testing and fuzzing. Empirical evaluation on real-world web applications demonstrates that the proposed framework significantly enhances the automation, efficiency, and practical feasibility of defect detection in query-based systems.
📝 Abstract
Testing query-based systems (QBSs) presents significant challenges due to the absence of ground truth for validation and the extensive time and effort required for manual testing. This paper addresses these challenges by proposing an approach that assists testers in identifying metamorphic relations (MRs) for metamorphic testing (MT) instead of solely and exhaustively relying on prerequisite domain knowledge. MT is an approach rising in popularity employed to alleviate the oracle problem by applying input transformation rules (MRs) to a program. The proposed approach helps the tester by prompting MRs that describe the relationships between inputs and outputs, enabling fault detection when the expected relationship is not met. Unlike traditional testing approaches, this approach does not rely on pre-defined test cases or concrete ground truth, making it suitable for the testing of real-world QBSs. Furthermore, the proposed approach can be combined with other testing methods such as combinatorial testing and fuzz testing, expanding the possibilities for QBS testing. A conducted case study of a real-world web application demonstrates the applicability and potential of the proposed approach. Overall, this research contributes to advancing the field of metamorphic testing and provides a valuable tool for QBS testers to enhance their testing efficiency.
Innovation
Methods, ideas, or system contributions that make the work stand out.
metamorphic testing
query-based systems
metamorphic relations
input relation prompting
oracle problem
🔎 Similar Papers
No similar papers found.
