Following the background given in Section 2, it is clear that general pre-training is insufficient for many knowledge-intensive tasks. To solve this, an additional post-processing step is essential to augment the knowledge of a pre-trained model. This step is often referred to as _knowledge injection_(Wang et al., 2020; Chen et al., 2022; Liu et al., 2020; Lauscher et al., 2020).