Blasi, Arianna Gorla, Alessandra Ernst, Michael D. Pezzè, Mauro Carzaniga, Antonio 2021-07-15 Software testing depends on effective oracles. Implicit oracles, such as checks for program crashes, are widely applicable but narrow in scope. Oracles based on formal specifications can reveal applicationspecific failures, but specifications are expensive to obtain and maintain. Metamorphic oracles are somewhere in-between. They test equivalence among different procedures to detect semantic failures. Until now, the identification of metamorphic relations has been a manual and expensive process, except for few specific domains where automation is possible. We present MeMo, a technique and a tool to automatically derive metamorphic equivalence relations from natural language documentation, and we use such metamorphic relations as oracles in automatically generated test cases. Our experimental evaluation demonstrates that 1) MeMo can effectively and precisely infer equivalence metamorphic relations, 2) MeMo complements existing state-of-the-art techniques that are based on dynamic program analysis, and 3) metamorphic relations discovered with MeMo effectively detect defects when used as test oracles in automatically-generated or manually-written test cases. application/pdf https://n2t.net/ark:/12658/srd1319212 https://susi.usi.ch/global/documents/319212 https://susi.usi.ch/documents/319212/files/Blasi_jss_2021.pdf eng info:eu-repo/semantics/altIdentifier/doi/10.1016/j.jss.2021.111041 info:eu-repo/semantics/altIdentifier/ark/12658/srd1319212 info:eu-repo/semantics/openAccess CC BY-NC-ND Journal of systems and software. - Elsevier. - 2021, vol. 181, p. 13 Software testing Test oracle generation Natural language processing info:eu-repo/classification/udc/004 MeMo : automatically identifying metamorphic relations in Javadoc comments for test automation http://purl.org/coar/resource_type/c_6501