This is an instance of an ordering effect we call the **Reversal Curse**. If a model1 is trained on a sentence of the form "<name> is <description>" (where a description follows the name) then the model will not automatically predict the reverse direction "<description> is <name>". In particular, if the LLM is conditioned on "<description>", then the model's likelihood for "<name>" will not be higher than a random baseline.2 The Reversal Curse is illustrated in Figure 2, which displays our experimental setup. Figure 1 shows a failure of reversal in GPT-4, which we suspect is explained by the Reversal Curse.