Novel ROC-type method for testing the efficiency of multivariate statistical methods in fMRI

The receiver operating characteristic (ROC) method is a useful and popular tool for testing the efficiency of various diagnostic tests applicable to functional MRI (fMRI) data. Typically, the diagnostic tests are applied on simulated and pseudo-human fMRI data, and the area under the ROC curve is used as a measure of the efficiency of the diagnostic test. The effectiveness of such a method depends on how well the simulated data approximate the real data. For multivariate statistical methods, however, this technique is usually inadequate, as the spatial dependence among voxels is ignored for simulated data. In this work a modified ROC method using real fMRI data with a broader scope is proposed. This method can be applied to most fMRI postprocessing techniques, including multivariate analyses such as canonical correlation analysis (CCA). Also, the relationship of the modified ROC method with the conventional ROC method is discussed in detail.