In the following sections, we first summarize the <cite>BERT</cite> architecture, then give details of shared task data set, and then describe experimental setups we used to train <cite>BERT</cite> model. In the results section, we compare the performance of <cite>BERT</cite> under different settings and share our submission results for the shared task.