While the world knowledge stored in LMs has diverse use cases, it can quickly become outdated as the world changes fast, and LMs need to frequently renew their internal world knowledge accordingly. For example, it is impossible to probe for _new_ information such as "_- _won the US Election 2020_" from the original T5 (Raffel et al., 2019) which was pretrained on C4 web corpus from April 2019.1 Also, information that may have once been considered accurate may no longer be valid because the information has been _updated_. For instance, the answer to "_Which soccer team does Cristiano Ronaldo play for?_" has changed from _Juventus_ to _Manchester United_ in September 2021. Meanwhile, _time-invariant_ information learned from the original corpus such as "_Barack Obama was born in Honolulu, Hawaii_" should not be altered within the LMs.