Input Relation Prompting for Metamorphic Testing on Query-Based Systems

Testing query-based systems (QBSs) presents significant challenges due to the absence of ground truth for validation and the extensive time and effort required for manual testing. This paper addresses these challenges by proposing an approach that assists testers in identifying metamorphic relations (MRs) for metamorphic testing (MT) instead of solely and exhaustively relying on prerequisite domain knowledge. MT is an approach rising in popularity employed to alleviate the oracle problem by applying input transformation rules (MRs) to a program. The proposed approach helps the tester by prompting MRs that describe the relationships between inputs and outputs, enabling fault detection when the expected relationship is not met. Unlike traditional testing approaches, this approach does not rely on pre-defined test cases or concrete ground truth, making it suitable for the testing of real-world QBSs. Furthermore, the proposed approach can be combined with other testing methods such as combinatorial testing and fuzz testing, expanding the possibilities for QBS testing. A conducted case study of a real-world web application demonstrates the applicability and potential of the proposed approach. Overall, this research contributes to advancing the field of metamorphic testing and provides a valuable tool for QBS testers to enhance their testing efficiency.