However, unlike the first-hop reasoning (SS5), the second-hop reasoning does not strengthen with increasing model size; when scaling from 7B to 13Band 70B, the maximum relative frequency remains relatively stable at 0.64 (7B), 0.65 (13B), and 0.61 (70B), as shown in Figure 2(c). It is worth noting that this finding aligns with the observation of Ofir Press et al. (2023), that the single-hop question answering performance improves faster than the multi-hop performance as the model size increases, and thus the _compositionality gap_ (the ratio of how often models can correctly answer all sub-problems but not generate the overall solution) does not decrease with increasing model size.