Medical expert systems: Issues of validation, evaluation and judgment

TY - CONF

T1 - Medical expert systems

T2 - 1988 Symposium Record on Policy Issues in Information and Communication Technologies in Medical Applications

AU - Kulikowski, Casimir A.

PY - 1988/1/1

Y1 - 1988/1/1

N2 - Medical expert systems often present quite difficult problems of validation and evaluation because their knowledge bases typically contain many implicitly represented value judgments, which may not be easily separated from statements of uncertainty and fact, as in a formal decision theoretic model. Thus, it is the very flexibility of knowledge representation allowed by expert system frameworks which makes the job of knowledge validation and system performance evaluation more complex than for simpler decision support systems. And, because of the ethical and legal constraints on medical knowledge utilization and testing, it has been difficult to produce systematic methodologies for evaluating the performance of these systems. It is therefore not surprising that they have not been as widely adopted as expert systems in other domains which have been derived from the pioneering work in medical systems. While new methods of knowledge base refinement hold out the promise for technical improvements, issues of responsibility for the application, testing and evaluation of expert systems will continue to provide fertile ground for discussion of the extra-logical elements of decision making.

AB - Medical expert systems often present quite difficult problems of validation and evaluation because their knowledge bases typically contain many implicitly represented value judgments, which may not be easily separated from statements of uncertainty and fact, as in a formal decision theoretic model. Thus, it is the very flexibility of knowledge representation allowed by expert system frameworks which makes the job of knowledge validation and system performance evaluation more complex than for simpler decision support systems. And, because of the ethical and legal constraints on medical knowledge utilization and testing, it has been difficult to produce systematic methodologies for evaluating the performance of these systems. It is therefore not surprising that they have not been as widely adopted as expert systems in other domains which have been derived from the pioneering work in medical systems. While new methods of knowledge base refinement hold out the promise for technical improvements, issues of responsibility for the application, testing and evaluation of expert systems will continue to provide fertile ground for discussion of the extra-logical elements of decision making.

UR - http://www.scopus.com/inward/record.url?scp=84941857449&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84941857449&partnerID=8YFLogxK

U2 - 10.1109/ICTMA.1988.669589

DO - 10.1109/ICTMA.1988.669589

M3 - Paper

SP - 45

EP - 56

Y2 - 29 September 1987 through 30 September 1987

ER -