In the future, we plan to apply multi-task learning to this context-dependent BERT, similar to the method mentioned in Da San<cite> Martino et al. (2019)</cite> or introducing other kinds of tasks, such as sentiment analysis or domain classification.