While some of the improvement is achieved by developing the pre-trained model itself, some other approaches resort to external modules, e.g. knowledge extraction and graph-based reasoning in [1]}. In our work, we are interested in the knowledge extraction method because developing the pre-trained model itself will be computationally expensive.
