To query LLMs, we use a template \(\tau(\cdot)\) to convert expressions \(r_{2}(e_{2})\) or \(r_{2}(r_{1}(e_{1}))\) into a prompt that can be completed correctly by the value of the given expression. For instance, the single-hop expression \(\texttt{mother}(\texttt{Stevie Wonder})\) could be converted by \(\tau(\texttt{mother}(\texttt{Stevie Wonder}))\) to the prompt _"The mother of Stevie Wonder is"_, which can be correctly completed with "Lula". Similarly, the two-hop expression \(\texttt{mother}(\texttt{singer}(\texttt{Superstition}))\) could be phrased by \(\tau(\texttt{mother}(\texttt{singer}(\texttt{Superstition})))\) as _"The mother of the singer of 'Superstition' is"_ with the same correct completion.