Open AccessBook
Dependability Benchmarking for Computer Systems
Karama Kanoun,Lisa Spainhower +1 more
- 07 Jan 2008
TL;DR: Dependability Benchmarking for Computer Systems provides a comprehensive collection of benchmarks for measuring dependability in hardware-software systems, and explains the concepts behind them.
read more
Abstract: As computer systems become more complex and mission-critical, it becomes imperative for systems engineers and researchers to have metrics for a system's "illities": dependability, reliability, availability, and serviceability. Written by leading experts, Dependability Benchmarking for Computer Systems provides a comprehensive collection of benchmarks for measuring dependability in hardware-software systems, and explains the concepts behind them. It collects the expert knowledge from DBench, a special research project funded by the European Union, to provide an inclusive text for engineers, researchers, system vendors, system purchasers, dependability researchers, computer industry consultants, and system integrators.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Challenges in Autonomous Vehicle Testing and Validation
Philip Koopman,Michael Wagner +1 more
TL;DR: Five major challenge areas in testing according to the V model for autonomous vehicles are identified: driver out of the loop, complex requirements, non-deterministic algorithms, inductive learning algorithms, and failoperational systems.
Assessing Dependability with Software Fault Injection: A Survey
TL;DR: This survey provides a comprehensive overview of the state of the art on Software Fault Injection to support researchers and practitioners in the selection of the approach that best fits their dependability assessment goals.
188
Assessing and Comparing Vulnerability Detection Tools for Web Services: Benchmarking Approach and Examples
Nuno Antunes,Marco Vieira +1 more
TL;DR: Results show that the benchmarks accurately portray the effectiveness of vulnerability detection tools (in a relative manner) and suggest that the proposed benchmarking approach can be applied in the field.
73
Experimental Analysis of Binary-Level Software Fault Injection in Complex Software
Domenico Cotroneo,Anna Lanzaro,Roberto Natella,Ricardo Luís Barbosa +3 more
- 08 May 2012
TL;DR: This work proposes a method for assessing the accuracy of binary-level fault injection, and provides an extensive experimental evaluation of abinary-level technique, G-SWFIT, in order to assess its limitations in a real-world complex software system.
Robustness-Driven Resilience Evaluation of Self-Adaptive Software Systems
TL;DR: This paper presents a novel approach for evaluating the resilience of self-adaptive software systems by applying robustness testing techniques to the controller to uncover failures that can affect system resilience.
References
•Proceedings Article
Towards availability benchmarks: a case study of software raid systems
Aaron B. Brown,David A. Patterson +1 more
- 18 Jun 2000
TL;DR: The methodology uses fault injection to provoke situations where availability may be compromised, leverages existing performance benchmarks for workload generation and data collection, and can produce results in both detail-rich graphical presentations or in distilled numerical summaries.
An approach towards benchmarking of fault-tolerant commercial systems
Timothy Tsai,Ravishankar K. Iyer,D. Jewitt +2 more
- 25 Jun 1996
TL;DR: The benchmark shows that Prototype B suffers fewer catastrophic incidents than Prototype A under the same workload conditions and fault injection method, however Prototype B also suffers more performance degradation in the presence of faults, which might be an important concern for time-critical applications.
117
Measuring software dependability by robustness benchmarking
A. Mukherjee,Daniel P. Siewiorek +1 more
TL;DR: A new hierarchically structured approach to building robustness benchmarks, which overcomes many deficiencies of past efforts, is presented and has been applied to building a hierarchic structured benchmark that tests part of the Unix file and virtual memory systems.
95
•Proceedings Article
DBench (Dependability Benchmarking)
Karama Kanoun,Henrique Madeira,Mario Dalcin,Francisco Moreira,Juan Carlos Ruiz Garcia +4 more
- 01 Jan 2001
46
Progress on Defining Standardized Classes for Comparing the Dependability of Computer Systems
Donald E. Wilson,Brendan Murphy,Lisa Spainhower +2 more
- 01 Jan 2002
TL;DR: The proposed classification system seeks to enable comparison of different computer systems in the dimensions of availability, data integrity, disaster recovery, and security.