**LoRA**(Hu et al., 2021) We only freeze the encoder for the encoder-decoder LM and the entire model for the decoder-only LM. We use the optimal rank \(r\) of 4 and adapt both \(W_{q}\) and \(W_{v}\) in the self-attention module, which corresponds to the best performing hyperparameter setting in the paper.