Skip to Main Content

Basic Principles of ROC Analysis

1978

The limitations of diagnostic "accuracy" as a measure of decision performance require introduction of the concepts of the "sensitivity" and "specificity" yet even these do not provide a unique description of diagnostic performance because they depend on the arbitrary selection of a decision threshold.

The receiver operating characteristic (ROC) curve is shown to be a simple yet complete empirical description of this decision threshold effect, indicating all possible combinations of the relative frequencies of the various kinds of correct and incorrect decisions. Practical experimental techniques for measuring ROC curves are described, and the issues of case selection and curve-fitting are discussed briefly.  The concepts of "average diagnostic cost" and "average net benefit" are developed and used to identify the optimal compromise among various kinds of diagnostic error. Finally, the way in which ROC analysis can be employed to optimize diagnostic strategies is suggested.

 

Source:

Metz CE. Basic Principles of ROC Analysis. Seminars in Nuclear Medicine 1978; 8 (4): 283-298. https://doi.org/10.1016/S0001-2998(78)80014-2

Not open access.