Remember Me
Or use your Academic/Social account:


Or use your Academic/Social account:


You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.


Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message


Verify Password:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Littlewood, B.; Popov, P. T.; Strigini, L. (2001)
Languages: English
Types: Article
Subjects: QA75
Design diversity has been used for many years now as a means of achieving a degree of fault tolerance in software-based systems. Whilst there is clear evidence that the approach can be expected to deliver some increase in reliability compared with a single version, there is not agreement about the extent of this. More importantly, it remains difficult to evaluate exactly how reliable a particular diverse fault-tolerant system is. This difficulty arises because assumptions of independence of failures between different versions have been shown not to be tenable: assessment of the actual level of dependence present is therefore needed, and this is hard. In this tutorial we survey the modelling issues here, with an emphasis upon the impact these have upon the problem of assessing the reliability of fault tolerant systems. The intended audience is one of designers, assessors and project managers with only a basic knowledge of probabilities, as well as reliability experts without detailed knowledge of software, who seek an introduction to the probabilistic issues in decisions about design diversity.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • [Adams 1984] E. N. Adams, “Optimizing preventive service of software products”, IBM Journal of Research and Development, 28 (1), pp.2-14, 1984.
    • [Ammann & Knight 1988] P. E. Ammann and J. C. Knight, “Data Diversity: An Approach to Software Fault Tolerance”, IEEE Transactions on Computers, C-37 (4), pp.418-425, 1988.
    • [Anderson et al. 1985] T. Anderson, P. A. Barrett, D. N. Halliwell and M. R. Moulding, “An Evaluation of Software Fault Tolerance in a Practical System”, in 15th IEEE Int. Symp. on Fault-Tolerant Computing (FTCS-15), Ann Arbor, Mich., pp.140-145, 1985.
    • [Babbage 1974] C. Babbage, “On the Mathematical Powers of the Calculating Engine (Unpublished manuscript, December 1837)”, in The Origins of Digital Computers: Selected Papers (B. Randell, Ed.), pp.17-52, Springer, 1974.
    • [Bishop 1988] P. G. Bishop, “The PODS diversity experiment”, in Software Diversity in Computerized Control Systems (U. Voges, Ed.), pp.51-84, Springer-Verlag, 1988.
    • [Bishop & Pullen 1988] P. G. Bishop and F. D. Pullen, “PODS Revisited - A Study of Software Failure Behaviour”, in 18th International Symposium on Fault-Tolerant Computing, Tokyo, Japan, pp.1-8, IEEE Computer Society Press, 1988.
    • [Blough & Sullivan 1990] D. M. Blough and G. Sullivan, “A Comparison of Voting Strategies for FaultTolerant Distributed Systems”, in 9th Symp. on Reliable Distributed Systems (SRDS-9), Huntsville, Alabama, pp.136- 145, 1990.
    • [Briere & Traverse 1993] D. Briere and P. Traverse, “Airbus A320/A330/A340 Electrical Flight Controls - A Family Of Fault-Tolerant Systems”, in 23rd International Symposium on Fault-Tolerant Computing (FTCS-23), Toulouse, France, 22 - 24, pp.616-623, IEEE Computer Society Press, 1993.
    • [Di Giandomenico & Strigini 1990] F. Di Giandomenico and L. Strigini, “Adjudicators for Diverse-Redundant Components”, in 9th Symposium on Reliable Distributed Systems (SRDS-9), Huntsville, Alabama, pp.114-123, IEEE, 1990.
    • [Dyer 1992] M. Dyer, The Cleanroom Approach to Quality Software Development, Software Engineering Practice, John Wiley and Sons, New York, 1992.
    • [Eckhardt & Lee 1985] D. E. Eckhardt and L. D. Lee, “A theoretical basis for the analysis of multiversion software subject to coincident errors”, IEEE Transactions on Software Engineering, SE-11 (12), pp.1511-1517, 1985. [FAA 1985] FAA, Federal Aviation Administration, Advisory Circular, N°AC 25.1309-1A, 1985.
    • [Hagelin 1988] G. Hagelin, “ERICSSON Safety Systems for Railway Control”, in Software diversity in computerized control systems (U. Voges, Ed.), 2, pp.11-21, Springer-Verlag, 1988.
    • [Huang et al. 1995] Y. Huang, C. Kintala, N. Kolettis and N. D. Fulton, “Software Rejuvenation: Analysis, Module and Applications”, in 25th International Symposium on Fault Tolerant Computing (FTCS-25), Pasadena , California, U.S.A., IEEE Computer Society Press, 1995.
    • [Hughes 1987] R. P. Hughes, “A New Approach to Common Cause Failure”, Reliability Engineering, 17, pp.211-236, 1987.
    • [Kantz & Koza 1995] H. Kantz and C. Koza, “The ELEKTRA Railway Signalling-System: Field Experience with an Actively Replicated System with Diversity”, in 25th IEEE Annual International Symposium on Fault -Tolerant Computing (FTCS-25), Pasadena, California, pp.453-458, IEEE Computer Society Press, 1995.
    • [Kersken & Saglietti 1992] M. Kersken and F. Saglietti (Eds.), Software Fault Tolerance: Achievement and Assessment Strategies, Research reports ESPRIT, Springer-Verlag, 1992.
    • [Knight & Amman 1985] J. C. Knight and P. E. Amman, “An Experimental evaluation of simple methods for seeding program errors”, in 8th International Conference on Software Engineering, pp.337-342, IEEE Computer Society, 1985.
    • [Knight & Leveson 1986] J. C. Knight and N. G. Leveson, “An Experimental Evaluation of the Assumption of Independence in Multi-Version Programming”, IEEE Transactions on Software Engineering, SE-12 (1), pp.96-109, 1986.
    • [Knight & Leveson 1990] J. C. Knight and N. G. Leveson, “A reply to the criticism of the Knight & Leveson experiment”, ACM SIGSOFT Software Engineering Notes, Vol. 15, No. 1, January, pp.24-35, 1990.
    • [Laprie et al. 1990] J. C. Laprie, J. Arlat, C. Beounes and K. Kanoun, “Definition and Analysis of Hardwareand-Software Fault-Tolerant Architectures”, IEEE Computer, 23 (7), pp.39-51, 1990.
    • [Laryd 1994] A. Laryd, “Operating experience of software in programmable equipment used in ABB Atom nuclear I&C application”, in Advanced Control and Instrumentation Systems in Nuclear Power Plants. Design, Verification and Validation. IAEA/IWG/ATWR & NPPCI Technical Committee Meeting, Espoo, Finland, (VTT-SYMP147), pp.31-42, 1994.
    • [Lee & Iyer 1995] I. Lee and R. K. Iyer, “Software Dependability in the Tandem GUARDIAN System”, IEEE Transactions on Software Engineering, 21 (5), pp.455-467, 1995.
    • [Lindeberg 1993] J. F. Lindeberg, “The Swedish State Railways' Experience with n-version Programmed Systems”, in Directions in Safety-Critical Systems (F. Redmill and T. Anderson, Eds.), p.36, Springer-Verlag, 1993.
    • [Littlewood 1996] B. Littlewood, “The impact of diversity upon common mode failures”, Reliability Engineering and System Safety, 51, pp.101-113, 1996.
    • [Littlewood & Miller 1989] B. Littlewood and D. R. Miller, “Conceptual Modelling of Coincident Failures in Multi-Version Software”, IEEE Transactions on Software Engineering, SE-15 (12), pp.1596-1614, 1989.
    • [Littlewood et al. 1999] B. Littlewood, P. Popov and L. Strigini, “A note on reliability estimation of functionally diverse systems”, Reliability Engineering and System Safety, 66, pp.93-95, 1999.
    • [Littlewood & Strigini 1993] B. Littlewood and L. Strigini, “Validation of Ultra-High Dependability for Software-based Systems”, Communications of the ACM, 36 (11), pp.69-80, 1993.
    • [Littlewood & Strigini 1998] B. Littlewood and L. Strigini, Guidelines for the statistical testing of software, Centre for Software Reliability, City University, Technical Report, July 1998.
    • [Lyu 1995] M. R. Lyu (Ed.), Software Fault Tolerance, Trends in Software, 337p., Wiley, 1995.
    • [Lyu 1996] M. R. Lyu (Ed.), Handbook of Software Reliability Engineering, IEEE Computer Society Press and McGraw-Hill, 1996.
    • [Migneault 1982] G. E. Migneault, The Cost of Software Fault Tolerance, NASA Langley Research Center, Technical Memorandum, N°TM-84546, September 1982.
    • [MoD 1996] MoD, Safety Management Requirements for Defence Standard, N°00-56, Issue 2, December 1996. Defence Systems, U.K. Ministry of Defence, [MoD 1997] MoD, Requirements for Safety Related Software in Defence Equipment, U.K. Ministry of Defence, Defence Standard, N°00-55, Issue 2, August 1997.
    • [Mongardi 1993] G. Mongardi, “Dependable Computing for Railway Control Systems”, in 3rd IFIP Int. Working Conference on Dependable Computing for Critical Applications (DCCA-3), Mondello, Italy, pp.255-277, 1993.
    • [Musa 1993] J. D. Musa, “Operational Profiles in Software-Reliability Engineering”, IEEE Software, March, pp.14-32, 1993.
    • [Nicola & Goyal 1990] V. F. Nicola and A. Goyal, “Modeling of Correlated Failures and Community Error Recovery in Multiversion Software”, IEEE Transactions on Software Engineering, 16 (3), pp.350-359, 1990.
    • [Popov et al. 1998] P. Popov, L. Strigini and M. Pizza, “The efficacy of diverse redundancy against design error: some practical considerations”, in INucE Third International Conference on Control and Instrumentation in Nuclear Installations, Edinburgh, U.K., 1998.
    • [Popov & Strigini 1998] P. T. Popov and L. Strigini, “Conceptual models for the reliability of diverse systems - new results”, in 28th International Symposium on Fault-Tolerant Computing (FTCS-28), Munich, Germany, pp.80-89, IEEE Computer Society Press, 1998.
    • [RTCA/EuroCAE 1992] RTCA/EuroCAE, DO-178B, Software Considerations in Airborne Systems and Equipment Certification, N°RTCA DO-178B/EUROCAE ED-12B, December 1992.
    • [Shooman 1996] M. Shooman, “Avionics Software Problem Occurrence Rates”, in ISSRE'96, Seventh International Symposium on Software Reliability Engineering, White Plains, New York, U.S.A., pp.55-64, 1996.
    • [Smith et al. 1991] I. C. Smith, D. N. Wall and J. A. Baldwin, “DARTS - an experiment into cost of and diversity in safety critical computer systems”, in IFAC/IFIP/EWICS/SRE Symposium on Safety of Computer Control Systems (SAFECOMP '91), (J. F. Lindeberg, Ed.), Trondheim, Norway, pp.35-39, Pergamon Press, 1991.
  • No related research data.
  • No similar publications.

Share - Bookmark

Download from

Cite this article