They introduce a novel Text-Image Embedding network (TieNet), which integrates self-attention LSTM using tex- tual report data and visual attention CNN using image data. TieNet is capable of extracting an informative embedding to represent the paired medical image and report, which significantly improves the disease classification performance compared to <cite>[16]</cite> .