InterpretabilityConventional interpretability research investigates the significance of input features with their corresponding outputs Vig (2019); Hewitt and Liang (2019); Qiu et al. (2020).In the era of LLMs, one brunch of work includes efforts to understand knowledge storage, with Geva et al. (2021) initiating the study of the feed-forward layer as a knowledge base. Subsequent work has furthered this by altering neuron values Dai et al. (2022), mapping embeddings to words Geva et al. (2022), modifying inputs to recover embeddings Meng et al.