It is not straightforward that the loss of LMs decides the performance on downstream tasks. For simplicity, we consider the Exact Match (EM) metric with single-token target. The score \(\mathrm{EM}(\hat{y},y)\) for the prediction \(\hat{y}\) of the prompt \(x\) given the ground truth \(y\) is 1 if \(\hat{y}=y\) and 0 otherwise.