* LoraHu et al. (2022): A method that incorporates trainable low-rank decomposition matrices into each layer of the Transformer-based model. In our implementation, we selectively adapt only the query and value projection matrices of each layer in the model. * (IA)\({}^{3}\)Liu et al. (2022): A technique involving element-wise multiplication of the model's activations with a learned vector. We rescale the key and value matrices in self-attention modules and the inner activations in feed-forward modules in each model layer.