After pre-training, LLMs can exhibit intriguing ICL capability without being updated. In what follows, we discuss two key questions about the ICL ability of LLMs, _i.e._, _"how does pre-training affect the ICL ability"_ and _"how do LLMs perform ICL during inference"_.