With the proposed PLND method, we then conduct extensive experiments to validate our hypothesis illustrated in Figure 2. We selectively disable neuron groups to study their effect on LLM multilingualism. Notably, deactivating the language-specific neurons in the understanding layer leaves English XQuAD performance stable but decreases non-English performance by \(14\%\). Other tasks including reasoning, knowledge question answering and NLG also exhibit the same characteristics. Moreover, enhancing the multilingual capabilities of LLMs can be achieved by fine-tuning language-specific neurons with merely \(200\) contextual examples. This method results in a substantial increase in model performance, with a \(7.4\%\) relative improvement on the XQuAD and an \(8.9\%\) enhancement on XSum, reducing the size of the required training dataset significantly.