An Experimental Evaluation of the Assumption of Independence in Multi-Version Programming

Authors:Knight, John, Department of Computer ScienceUniversity of Virginia Leveson, Nancy, Department of Computer ScienceUniversity of Virginia

N - version programming has been proposed as a method of incorporating fault tolerance into software. Multiple versions of a program (i.e. "N") are prepared and executed in parallel. Their outputs are collected and examined by a voter, and, if they are not identical, it is assumed that the majority is correct. This method depends for its reliability improvement on the assumption that programs that have been developed independently will fail independently. In this paper an experiment is described in which the fundamental axiom is tested. A total of twenty - seven versions of a program were prepared independently from the same specification at two universities and then subjected to one million tests. The results of the tests revealed that the programs were individually extremely reliable but that the number of tests in which more than one program failed was substantially more than expected. The results of these tests are presented along with an analysis of some of the faults that were found in the programs. Background information on the programmers used is also summarized. The conclusion from this experiment is that N - version programming must be used with care and that analysis of its reliability must include the eifect of dependent errors.
Note: Abstract extracted from PDF file via OCR

All rights reserved (no additional license for public reuse)
Source Citation:

Knight, John, and Nancy Leveson. "An Experimental Evaluation of the Assumption of Independence in Multi-Version Programming." University of Virginia Dept. of Computer Science Tech Report (1985).

University of Virginia, Department of Computer Science
Published Date: