Interpretable Fusion Analytics Framework for fMRI Connectivity: Self-Attention Mechanism and Latent Space Item-Response Model
There have been several attempts to use deep learning based on brain fMRI
signals to classify cognitive impairment diseases. However, deep learning is a
hidden black box model that makes it difficult to interpret the process of
classification. To address this issue, we propose a novel analytical framework
that interprets the classification result from deep learning processes. We
first derive the region of interest (ROI) functional connectivity network (FCN)
by embedding functions based on their similar signal patterns. Then, using the
self-attention equipped deep learning model, we classify diseases based on
their FCN. Finally, in order to interpret the classification results, we employ
a latent space item-response interaction network model to identify the
significant functions that exhibit distinct connectivity patterns when compared
to other diseases. The application of this proposed framework to the four types
of cognitive impairment shows that our approach is valid for determining the
significant ROI functions.