Reasoning in Uncertainties: An Analysis of Five Strategies and Their Suitability in Pathology

TL;DR: It is preliminarily concluded that the different aspects of uncertainty are expressed as separate entities only in Pathfinder and probability theory, and the other models do not accurately represent uncertain knowledge.

Abstract: In reasoning systems, uncertainty plays a crucial part, especially for those fields in which judgements are essential, as in pathology. Uncertainty has several aspects, such as prevalence of diseases, occurrence of findings and the sensitivity and predictive value of findings. For the functioning of a reasoning system, two aspects are crucial: (1) the internal representation of the uncertainty and (2) the way in which the uncertainty is propagated in the reasoning process when combining formal statements. Five well-known reasoning strategies (Bayes' probability theory, MYCIN's certainty factor model, fuzzy set theory, the theory of Dempster-Shafer and Pathfinder's scoring mechanism) are compared, with particular attention to: (1) Under what conditions will the model function? In particular, what information is to be specified a priori to the system? (2) Can the different aspects of uncertainty be dealt with as separate entities? (3) How are unknown uncertainties dealt with? (4) How is evidence in favor of a hypothesis combined with evidence against it? (5) How does the model treat the simultaneous occurrence of more than one disorder, that is, how does the model support reasoning with compound hypotheses? It is preliminarily concluded that the different aspects of uncertainty are expressed as separate entities only in Pathfinder and probability theory. Hence, the other models do not accurately represent uncertain knowledge. Also, such theoretically attractive models as the Bayes, MYCIN and Dempster-Shafer theory can only function properly under the tight condition of mutual exclusiveness of hypotheses, which is not always suited for broader areas of pathology. They may, however, be suited for smaller areas, with a limited number of defined diseases and a limited number of features. All models but the Bayes model lack a predictable performance since there is no (or only a partial) underlying theory to guarantee minimization of the overall error.