Proceedings Article10.1109/DSN.2012.6263914
Binary mutation testing through dynamic translation
Markus Becker,Christoph Kuznik,Mabel Mary Joy,Tao Xie,Wolfgang Mueller +4 more
- 25 Jun 2012
- pp 1-12
TL;DR: This paper presents a novel mutation based testing method through binary mutation that captures target specific faults related to compiling and linking and investigates the software of an automotive case study.
read more
Abstract: This paper presents a novel mutation based testing method through binary mutation. For this, a table of mutants is derived by control flow analysis of a disassembled binary under test. Mutations are injected at runtime by dynamic translation. Thus, our approach neither relies on source code nor a certain compiler. As instrumentation is avoided, testing results correspond to the original binary. In addition to high-level language faults, the proposed approach captures target specific faults related to compiling and linking. We investigated the software of an automotive case study. For this, a taxonomy of mutation operators for the ARM instruction set is proposed. Our experimental results prove 100% accuracy w.r.t. confidence metrics provided by conventional testing methods while avoiding significant mutant compilation overhead. Further speed up is achieved by an efficient binary mutation testing framework that relies on extending the open source software emulator QEMU.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
DeepMutation: Mutation Testing of Deep Learning Systems
Lei Ma,Lei Ma,Fuyuan Zhang,Jiyuan Sun,Minhui Xue,Bo Li,Felix Juefei-Xu,Chao Xie,Li Li,Yang Liu,Jianjun Zhao,Yadong Wang +11 more
- 16 Nov 2018
TL;DR: This paper proposes a mutation testing framework specialized for DL systems to measure the quality of test data, and designs a set of model-level mutation operators that directly inject faults into DL models without a training process.
427
•Posted Content
DeepMutation: Mutation Testing of Deep Learning Systems
Lei Ma,Lei Ma,Fuyuan Zhang,Jiyuan Sun,Minhui Xue,Bo Li,Felix Juefei-Xu,Chao Xie,Li Li,Yang Liu,Jianjun Zhao,Yadong Wang +11 more
TL;DR: Zhang et al. as mentioned in this paper proposed a mutation testing framework for DL systems to measure the quality of test data, by defining a set of source-level mutation operators to inject faults to the source of DL (i.e., training data and training programs).
133
Safety Evaluation of Automotive Electronics Using Virtual Prototypes: State of the Art and Research Challenges
Jan-Hendrik Oetjens,Nico Bannow,Markus Becker,Oliver Bringmann,Andreas Burger,Moomen Chaari,Samarjit Chakraborty,Rolf Drechsler,Wolfgang Ecker,Kim Grüttner,Th. Kruse,Christoph Kuznik,Hoang M. Le,Andreas Mauderer,Wolfgang H. Müller,Daniel Muller-Gritschneder,Frank Poppen,Hendrik Post,Sebastian Reiter,Wolfgang Rosenstiel,S. Roth,Ulf Schlichtmann,A. von Schwerin,Bogdan-Andrei Tabacaru,Alexander Viehl +24 more
- 01 Jun 2014
TL;DR: This paper shows the advantages of such a methodology based on today's industrial needs, presents the current state of the art in this field, and outlines upcoming research challenges that need to be addressed to make this vision a reality.
58
Mutation Integration Testing
Mark Grechanik,Gurudev Devanla +1 more
- 01 Aug 2016
TL;DR: A fault model for integration bugs is formulated that uses static dataflow analysis to obtain information about how integrated components interact in an application and reduces the number of generated mutants by up to approximately 19 times with a strong power to determine inadequacies in integration test suites.
15
HeroeS: Virtual platform driven integration of heterogeneous software components for multi-core real-time architectures
Markus Becker,Ulrich Kiffmeier,Wolfgang Mueller +2 more
- 19 Jun 2013
TL;DR: The HeroeS virtual platform driven methodology for embedded multi-core and real-time SW design focuses on early integration, testing and performance estimation of heterogeneous SW stacks, i.e., SW components and layers at mixed abstraction levels and/or targeting different instruction sets.
6
References
•Proceedings Article
QEMU, a fast and portable dynamic translator
Fabrice Bellard
- 10 Apr 2005
TL;DR: QEMU supports full system emulation in which a complete and unmodified operating system is run in a virtual machine and Linux user mode emulation where a Linux process compiled for one target CPU can be run on another CPU.
Hints on Test Data Selection: Help for the Practicing Programmer
TL;DR: In many cases tests of a program that uncover simple errors are also effective in uncovering much more complex errors, so-called coupling effect can be used to save work during the testing process.
2.2K
An Analysis and Survey of the Development of Mutation Testing
Yue Jia,Mark Harman +1 more
TL;DR: These analyses provide evidence that Mutation Testing techniques and tools are reaching a state of maturity and applicability, while the topic of Mutation testing itself is the subject of increasing interest.
1.8K
MuJava: an automated class mutation system
TL;DR: This paper presents a method to reduce the execution cost of mutation testing for OO programs by using two key technologies, mutant schemata generation (MSG) and bytecode translation.
Emulation of Software Faults: A Field Data Study and a Practical Approach
Joao Duraes,Henrique Madeira +1 more
TL;DR: A new software fault injection technique (G-SWFIT) based on emulation operators derived from the field study is proposed that consists of finding key programming structures at the machine code-level where high-level software faults can be emulated.
312
Related Papers (5)
Vadim Okun,Yaacov Yesha +1 more
- 01 Jan 2004
Paul Ammann,Paul E. Black,W. Majurski +2 more
- 09 Dec 1998