Among those, <cite>BERT</cite> attracts researchers most because of (i) its transformer based architecture enabling faster training and (ii) state of the art results in many different tasks. Though it is quite new, <cite>BERT</cite> has been tried in many different domains than the one proposed in <cite>Devlin et al. (2018)</cite> .