On the other hand, as models keep scaling, the world knowledge encoded in their parameters does too [16]. Many previous efforts have shown that language models are able to memorize a significant amount of world knowledge and achieve competitive performance on tasks such as open-domain question answering when they just use their parametric knowledge for solving the task [20, 1, 34, 35].