research-article

Case-based software reliability assessmentby fault injection unified procedures

Authors:

Alexander Gordeyev,

Vyacheslav Kharchenko,

Anton Andrashov,

Vladimir Sklyar,

Artem BoyarchukAuthors Info & Claims

SEESE '08: Proceedings of the 2008 international workshop on Software Engineering in east and south europe

Pages 1 - 8

https://doi.org/10.1145/1370868.1370870

Published: 13 May 2008 Publication History

Abstract

The fault injection methods and tools are presented and analyzed. The unified procedures of software fault injection for assessment of software testing and quality verification on different development stages are proposed. Quality evaluation technique of software testing and verification is described. The results of using the developed tools «InExp» and «SoftAsVer» are presented.

References

[1]

V.S. Kharchenko, V.Sklyar, O.M.Tarasyuk, "Risks Analysis of the Space Rockets Crashes: Evolution of Tendencies and Causes, Radio-Electronic and Computer Systems, Ukraine, 2003 Num. 3, pp. 135 -- 149. (In Ukrainian)

[2]

NASA Releases Accident Report Summary', DOI= http://lenta.ru/news/2006/05/16/dart/, 2006.

[3]

International Standard ISO/IEC 25000 Software engineering -- Software product Quality Requirements and Evaluation (SQuaRE) -- Guide to SquaRE, ISO/IEC, 2005.

[4]

S.A.Vilkomir, J.P.Bowen, "Establishing Formal Regulatory Requirements for Safety-Critical Software Certification, Proceedings of AQuIS 2002: 5th International Conference on Achieving Quality In Software and SPICE 2002: 2nd International Conference on Software Process Improvement and Capability Determination, Venice, Palazzo Papafava, 13--15 March 2002, pp. 7--18.

[5]

ISO/IEC 9126-2.3. Software Engineering -- Product Quality Part 2 -- External Metrics. JTC1. PDTR. -- 2000. -- 119 p.

[6]

Hsueh Mei-Chen, Timothy K. Tsai, Ravishankar K. Iyer, "Fault Injection Techniques and Tools, Computer, April 1997. -- pp. 75--82.

Digital Library

[7]

David N. Card, "Managing Software Quality with Defect", 26th Annual International Computer Software and Applications Conference (COMPSAC 2002), 2002, pp. 472--475.

Digital Library

[8]

J. Vinter, P. Folkesson, J. Karlsson, "GOOFI : Generic Object-Oriented Fault Injection Tool, Dependable Computing Department of Computer Engineering Chalmers University of Technology. Report - S-412 96, Goteborg, Sweden, 1996.

[9]

S. Han, K. G. Shin, H. A. Rosenberg, DOCTOR: An integrated software fault injection environment for distributed real-time systems, In IEEE Int. 7 Computer Performance and Dependability Symp. (IPDS'95), March 1995, pp. 204--213.

Digital Library

[10]

G. A. Kanawati, N. A. Kanawati, Abraham J. A., "FERRARI: A tool for the validation of system dependability properties", In Proc. of the 22nd Int'l Symp. on Fault-Tolerant Computing (FTCS-22), July 1992, pp. 336--344.

[11]

E. Jenn, J. Arlat, M. Rimen, J. Ohlsson, "Fault injection into VHDL models: The MEFISTO tool, In Proc. of the 24nd Int'l Symp. on Fault--Tolerant Computing (FTCS-24), June 1994, pp. 66--75.

[12]

K. K. Goswami, R. K. Iyer, L. Young, "DEPEND: A simulation-based environment for system level dependability analysis, IEEE Transactions on Computers, 46 (1) 1997, pp. 1--74.

Digital Library

[13]

W.-L. Kao, R. K. Iyer, D. Tang, "FINE: A fault injection and monitoring environment for tracing the Unix system behavior under faults, IEEE Trans. Software Eng, November 19(11) 1993, pp. 1105--1118.

Digital Library

[14]

W. Kao, R. K. Iyer, "DEFINE: A distributed fault injection and monitoring environment, IEEE Workshop on Fault-Tolerant Parallel and Distributed System, June 1994, pp. 45--54.

[15]

J. Carreira, H. Madeira, J. G.Silva, "Xception: Software fault injection and monitoring in processor functional units, In Proc. of the 5th IFIP Int'l Working Conf. Dependable Computing for Critical Applications (DCCA-5), September 1995, pp. 135--149.

[16]

J. Carreira, H. Madeira, J. G.Silva, "Xception: A technique for the evaluation of dependability in modern computers, IEEE Trans. Software Eng, 24(2) 1998, pp.45--52.

Digital Library

[17]

K. Echtle, M. Leu, "The EFA fault injector for fault-tolerant distributed system testing, In IEEE Workshop on Fault-Tolerant Parallel and Distributed Systems, July 1992, pp. 28--35.

[18]

J. Carreira, M. Henrique, G. Joao, "Assessing the Effects of Communication Faults on Parallel Applications, Procceedings of International Computer and Dependability Symposium (IPDS'95), Erlangen Germany, April 1995, pp. 214--223.

Digital Library

[19]

M. Cukier, R. Chandra, D. Henke, J. Pistole, "Fault injection based on a partial view of the global state of a distributed system, In Proc. of the 18th Symposium on Reliable Distributed Systems (SRDS'99), October 1999, pp. 168--177.

Digital Library

[20]

T. K. Tsai, R. K. Iyer, "An approach to benchmarking of fault-tolerant commercial systems, In Proc. of the 26th Int'l Symp. on Fault-Tolerant Computing (FTCS-26), June 1996, pp. 314--323.

Digital Library

[21]

N. Looker, J. Xu, "Assessing the Dependability of OGSA Middleware by Fault Injection, Proceedings of the Symposium on Reliable Distributed Systems, 2003, pp. 293--302.

[22]

S. Dawson, F. Jahanian, T. Mitton, "ORCHESTRA: A Fault Injection Environment for Distributed Systems, In Proc. 26th Int. Symp. on Fault Tolerant Computing (FTCS-26), Sendai Japan, June 1996, pp. 404--414.

[23]

Z.Segall, D. Vrsalovic, D. Siewiorek, D. Yaskin, "FIAT -- fault injection based automated testing environment, In Proc. of the 18th Int'l Symp. on Fault-Tolerant Computing (FTCS--18), June 1988, pp. 102--107.

[24]

M. Blaschka, "FIESTA: A Framework for Schema Evolution in Multidimensional Information Systems, In Proc. 6th CAiSE Doctoral Consortium, Heidelberg Germany, June 1999, pp. 95--103.

[25]

D.T. Stott, "Automated Fault-Inject Based Dependability Analysis of Distributed Computer Systems, Report for Preliminary Exam Science Laboratory University of Illinois, Feb 2000.

Digital Library

[26]

A. Benso, P. Prinetto, M. Rebaudengo, "EXFI: a low-cost fault injection system for embedded microprocessor-based boards, TODAES, 3(4) 1998, pp. 626--634.

Digital Library

[27]

S. Dawson, J. Farnam, T. Mitton, "A Software Fault Injection Tool on Real-Time", 16th IEEE Real-Time Systems Symposium (RTSS '95), 1995, 130 p.

Digital Library

[28]

Li Xiaoyan, Martin Richard P., Nagaraja Kiran, "Mendosus: A SAN-based Fault-Injection Test-Bed for Construction of Highly Available Network Services, In Proceedings of the 1st Workshop on Novel Uses of System Area Networks (SAN-1), Feb 2002, pp. 121--127.

[29]

H.-J.Hoxer, K. Buchacker, V. Sieh, "UMLinux -- a tool for testing a linux system's fault tolerance, In LinuxTag, Karlsruhe Germany, June 2002, pp. 63--97.

[30]

M. elles, J. siE, The science of debugging,".: KYDIC- IMAGE, 2003.

Digital Library

[31]

M.R.Lyu, Handbook of Software Reliability Engineering, IEEE Computer Society Press, 1995.

Digital Library

[32]

Y. Huang, C. Kintala, N. Kolettis, N. Fulton, "Software Rejuvenation: Analysis, Module and Applications, In Proceedings of the 1995 International Symposium on Fault-Tolerant Computing, June 1995, pp. 381--390.

Digital Library

[33]

R. Polonnikov, A. Nikandrov, Methods of software dependability assessment, SPb.: Polytechnika, 1992. (In Russian)

[34]

M .X. Holsted, The beginning of science about the program, M.: Finances and statistics, 1981.

[35]

T.A. McCabe, "Complexity Measure", IEEE Transactions on Software Engineering, Vol. 4 1976, pp. 308--320.

Digital Library

[36]

J.R.Gaffney, "Estimating the Number of Faults in Code", IEEE Trans. Software Eng, vol. 10 (4)1984, pp. 357--362.

[37]

V.S. Kharchenko, O.M. Tarasyuk, "The using of radial-metrics diagrams to asses software characteristics, Extensible integrated informational and computer-based systems, Kharkiv: National Aerospace University, Vol. 18 2003, pp. 123--133. (In Ukrainian)

[38]

Preckshot G.G., Scott J. A Proposed Acceptance Process for Commercial Off-the-Shelf (COTS) Software in Reactor Applications Lawrence Livermore National Laboratory. -- 1995. -- 123 p.

[39]

El Emam Khaled, Wieczorek Isabella. The Repeatability of Code Defect Classifications Fraunhofer Institute for Experimental Software Engineering. International Software Engineering Research Network Technical Report ISERN-98-09. - 1998. - 21 p.

[40]

V. Kharchenko, V.Sklyar, B. Konorev, G. Chertkov, Yu. Alexeev, S. Zasuha, L. Semenov. Space Systems Software Quality Assessment and Ensuring, Kharkiv, National Space Agency of Ukraine. -- 2007. -- 243 p.

Cited By

Gordieiev OGordieieva DRainer A(2023)Software Quality Assessment: Defect Life Cycle, Software Defect Profile, Its Types and MisalignmentsSoftware Quality: Higher Software Quality through Zero Waste Development10.1007/978-3-031-31488-9_6(109-120)Online publication date: 13-May-2023
https://doi.org/10.1007/978-3-031-31488-9_6
Gordieiev OIsrael MKharchenko V(2020)Якість програмного забезпечення: моделі оцінювання доцільності засіву та життєвий цикл профілю дефектівScientific Bulletin of UNFU10.36930/4030051930:5(114-121)Online publication date: 3-Nov-2020
https://doi.org/10.36930/40300519
Linares-Vasquez MMoran KPoshyvanyk D(2017)Continuous, Evolutionary and Large-Scale: A New Perspective for Automated Mobile App Testing2017 IEEE International Conference on Software Maintenance and Evolution (ICSME)10.1109/ICSME.2017.27(399-410)Online publication date: Sep-2017
https://doi.org/10.1109/ICSME.2017.27
Show More Cited By

Index Terms

Case-based software reliability assessmentby fault injection unified procedures
1. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software implementation planning
        Software design techniques
    2. Software development process management
      1. Software development methods

Recommendations

On the Emulation of Software Faults by Software Fault Injection
DSN '00: Proceedings of the 2000 International Conference on Dependable Systems and Networks (formerly FTCS-30 and DCCA-8)

This paper presents an experimental study on the emulation of software faults by fault injection. In a first experiment, a set of real software faults has been compared with faults injected by a SWIFI tool (Xception) to evaluate the accuracy of the ...
Fault Injection for Software Certification

As software becomes more pervasive and complex, it's increasingly important to ensure that a system will be safe even in the presence of residual software faults (or bugs). Software fault injection consists of the deliberate introduction of software ...
Fault Injection and Dependability Evaluation of Fault-Tolerant Systems

The authors describe a dependability evaluation method based on fault injection that establishes the link between the experimental evaluation of the fault tolerance process and the fault occurrence process. The main characteristics of a fault injection ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SEESE '08: Proceedings of the 2008 international workshop on Software Engineering in east and south europe

May 2008

122 pages

ISBN:9781605580760

DOI:10.1145/1370868

General Chairs:
Ivica Crnković
Mälardaln University, Sweden
,
Jerzy Nawrocki
Poznan University, Poland

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '08

Sponsor:

ICSE '08: International Conference on Software Engineering

May 13, 2008

Leipzig, Germany

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
319
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gordieiev OGordieieva DRainer A(2023)Software Quality Assessment: Defect Life Cycle, Software Defect Profile, Its Types and MisalignmentsSoftware Quality: Higher Software Quality through Zero Waste Development10.1007/978-3-031-31488-9_6(109-120)Online publication date: 13-May-2023
https://doi.org/10.1007/978-3-031-31488-9_6
Gordieiev OIsrael MKharchenko V(2020)Якість програмного забезпечення: моделі оцінювання доцільності засіву та життєвий цикл профілю дефектівScientific Bulletin of UNFU10.36930/4030051930:5(114-121)Online publication date: 3-Nov-2020
https://doi.org/10.36930/40300519
Linares-Vasquez MMoran KPoshyvanyk D(2017)Continuous, Evolutionary and Large-Scale: A New Perspective for Automated Mobile App Testing2017 IEEE International Conference on Software Maintenance and Evolution (ICSME)10.1109/ICSME.2017.27(399-410)Online publication date: Sep-2017
https://doi.org/10.1109/ICSME.2017.27
Gordieiev OKharchenko VFominykh NSklyar V(2014)Evolution of Software Quality Models in Context of the Standard ISO 25010Proceedings of the Ninth International Conference on Dependability and Complex Systems DepCoS-RELCOMEX. June 30 – July 4, 2014, Brunów, Poland10.1007/978-3-319-07013-1_21(223-232)Online publication date: 2014
https://doi.org/10.1007/978-3-319-07013-1_21
Reva LKulanov VKharchenko V(2011)Design fault injection-based technique and tool for FPGA projects verificationProceedings of the 2011 9th East-West Design&Test Symposium10.1109/EWDTS.2011.6116608(191-195)Online publication date: 9-Sep-2011
https://dl.acm.org/doi/10.1109/EWDTS.2011.6116608

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents