Interpretable Anomaly Detection in Echocardiograms with Dynamic Variational Trajectory Models
We propose a novel anomaly detection method for echocardiogram videos. The
introduced method takes advantage of the periodic nature of the heart cycle to
learn different variants of a variational latent trajectory model (TVAE). The
models are trained on the healthy samples of an in-house dataset of infant
echocardiogram videos consisting of multiple chamber views to learn a normative
prior of the healthy population. During inference, maximum a posteriori (MAP)
based anomaly detection is performed to detect out-of-distribution samples in
our dataset. The proposed method reliably identifies severe congenital heart
defects, such as Ebstein's Anomaly or Shonecomplex. Moreover, it achieves
superior performance over MAP-based anomaly detection with standard variational
autoencoders on the task of detecting pulmonary hypertension and right
ventricular dilation. Finally, we demonstrate that the proposed method provides
interpretable explanations of its output through heatmaps which highlight the
regions corresponding to anomalous heart structures.