For each two-hop prompt \(\tau_{\text{2H}}\) in TwoHopFact, we randomly select one \(e_{1}^{\prime}\) from the same fact composition type and one \(r_{1}^{\prime}\) from a set of predefined candidate relations (provided in Appendix Table 5) to create \(\tau_{\text{2H}}^{\prime}\). We then measure the relative frequency of cases where replacing \(\tau_{\text{2H}}^{\prime}\) with \(\tau_{\text{2H}}\) via entity or relation substitution increases the recall of \(e_{2}\). A relative frequency above 0.5 suggests the LLM's chance to perform first-hop reasoning exceeds the random chance for these prompts.