Open AccessJournal Article10.1360/JOS161210

Metamorphic Testing and Special Case Testing: A Case Study

- 01 Jan 2005

- Vol. 16, Iss: 7, pp 1210

TL;DR: An experimental analysis of the effectiveness of metamorphic testing is reported, which is carried out using MTest with a real program of sparse matrix multiplication, which shows that metamorphIC testing and special case testing are complementary to each other, and with.

Abstract: This paper presents an integrated metamorphic testing environment MTest and reports an experimental analysis of the effectiveness of metamorphic testing, which is carried out using MTest with a real program of sparse matrix multiplication. Quantitative evaluation and comparison of special case testing, metamorphic testing with special and random test cases are illustrated with two measurements: mutation score and fault detection ratio. The case study shows that metamorphic testing and special case testing are complementary to each other, and with

AI Agents for this Paper

Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps

Most frequently asked questions

1. What have the authors contributed in "Metamorphic testing and special case testing: a case study" ?

This paper presents an integrated metamorphic testing environment MTest and reports an experimental analysis of the effectiveness of metamorphic testing, which is carried out using MTest with a real program of sparse matrix multiplication.

2. What have the authors stated for future works in "Metamorphic testing and special case testing: a case study" ?

As future work, the authors would like to extend metamorphic testing by using their sequential combinations, which may result in a general framework for metamorphic testing.

Table 4 Mutation score and fault detection ratio of special case testing and metamorphic testing with special test cases (Nc = 8, Nm = 9)

Table 5 Fault detection ratio of metamorphic testing vs. special case testing

Table 1 Atomic properties for sparse matrix multiplication

Table 3 Test verdicts report by special case testing and metamorphic testing with special test cases

Table 6 Mutation score and fault detection ratio of metamorphic testing with random test cases (Nc = 8, Nc = 9)

Citations

•Journal Article•10.1109/TSE.2016.2532875

A Survey on Metamorphic Testing

Sergio Segura, +3 more

- 01 Sep 2016

- IEEE Transactions on Software Engineerin...

TL;DR: This article provides a comprehensive survey on metamorphic testing, which summarises the research results and application areas, and analyses common practice in empirical studies of metamorphIC testing as well as the main open challenges.

...read moreread less

545

•Journal Article•10.4018/JWSR.2012010103

A Metamorphic Relation-Based Approach to Testing Web Services Without Oracles

Tsong Yueh Chen, +5 more

- 01 Jan 2012

- International Journal of Web Services Re...

TL;DR: The work presented in the paper not only alleviates the test oracle problem of testing Web services, but also delivers an effective and efficient test technique without oracles.

...read moreread less

Proceedings Article•10.1109/COMPSAC.2005.93

Iterative metamorphic testing

Peng Wu

- 26 Jul 2005

TL;DR: An enhanced version of metamorphic testing, namely n-iterative metamorphics testing, is proposed to systematically exploit more information out of met morphological tests by applying metamorphIC relations in a chain style.

...read moreread less

Proceedings Article•10.1109/QSIC.2007.4385510

An Effective Iterative Metamorphic Testing Algorithm Based on Program Path Analysis

Guowei Dong, +3 more

- 11 Oct 2007

TL;DR: A new iterative MT algorithm, APCEMSI, is presented to avoid the blindness of existing MT methods and shows that APCemSI could find errors effectively with much fewer test cases.

...read moreread less

•Proceedings Article

An optimized method for generating cases of metamorphic testing

Leilei Chen, +5 more

- 01 Oct 2012

TL;DR: A criterion called ECCEM (Equivalence-Class Coverage for Every Metamorphic Relation), which covers the test cases based on equivalence classes, the criterion can availably generate fewer test case sets with high detection rate.

...read moreread less

...

Expand

References

Journal Article•10.1109/C-M.1978.218136

Hints on Test Data Selection: Help for the Practicing Programmer

Richard A. DeMillo, +2 more

- 01 Apr 1978

- IEEE Computer

TL;DR: In many cases tests of a program that uncover simple errors are also effective in uncovering much more complex errors, so-called coupling effect can be used to save work during the testing process.

...read moreread less

2.2K

•Book

Encyclopedia of software engineering

John J. Marciniak

- 01 Jan 2002

TL;DR: Organized alphabetically--every major area contains an overview article that defines the topic, and each sub-discipline has a specific article covering history, current practice, practical data and projections about future practice.

...read moreread less

1.1K

Proceedings Article•10.1109/WST.1988.5369

An extended overview of the Mothra software testing environment

Richard A. DeMillo, +4 more

- 19 Jul 1988

- Water Science and Technology

TL;DR: The authors present some major problems with using mutation analysis and discuss possible solutions and conclude with a solution to one of these problems-a method of automatically generating mutation-adequate data.

...read moreread less

294

•Proceedings Article•10.1145/154183.154265

Mutation analysis using mutant schemata

Roland H. Untch, +2 more

- 01 Jul 1993

TL;DR: A new method for performing mutation analysis that uses program schemata to encode all mutants for a program into one metaprogram, which is subsequently compiled and run at speeds substantially higher than achieved by previous interpretive systems.

...read moreread less

215

•Proceedings Article•10.1109/CMPSAC.2002.1045022

Metamorphic testing of programs on partial differential equations: a case study

Tsong Yueh Chen, +2 more

- 26 Aug 2002

TL;DR: The effect of applying metamorphic testing to alleviate the oracle problem for numerical programs and a case study on the testing of a program that solves an elliptic partial differential equation with Dirichlet boundary conditions.

...read moreread less

133

Metamorphic Testing and Special Case Testing: A Case Study

Chat with Paper

AI Agents for this Paper

Most frequently asked questions

1. What have the authors contributed in "Metamorphic testing and special case testing: a case study" ?

2. What have the authors stated for future works in "Metamorphic testing and special case testing: a case study" ?

Figures

Citations

A Survey on Metamorphic Testing

A Metamorphic Relation-Based Approach to Testing Web Services Without Oracles

Iterative metamorphic testing

An Effective Iterative Metamorphic Testing Algorithm Based on Program Path Analysis

An optimized method for generating cases of metamorphic testing

References

Hints on Test Data Selection: Help for the Practicing Programmer

Encyclopedia of software engineering

An extended overview of the Mothra software testing environment

Mutation analysis using mutant schemata

Metamorphic testing of programs on partial differential equations: a case study

Related Papers (5)

Metamorphic Testing and Testing with Special Values.

On Testing Non-Testable Programs

A Metamorphic Testing Approach for Online Testing of Service-Oriented Software Applications

Iterative metamorphic testing

Metamorphic testing of programs on partial differential equations: a case study