We adopt the performance on XQuAD in Chinese as the validation set to all languages and all tasks. Specifically, Table 9 shows the result on Vicuna when deactivating language-specific neurons in the understanding layer (\(D_{\mathcal{U}}\)) and generation layer (\(D_{\mathcal{G}}\)), where \(N_{1}\) is the number of understanding layers and \(N_{2}\) is the number of generation layer. We find that when setting \(N_{1}=8\) and \(N_{2}=2\), performance in English is influenced the least while performance in Chinese decreases the most. As for Mistral, the number is \(N_{1}=6\) and \(N_{2}=3\).