We plot KL and bitwise Hamming Distance relative to the position of the synonym swap in Figure 2. If LMs did not contain residual information about previous words, we would expect bitwise distance to decay to zero as we move away from the position of the swap. However, we observe that bits remain: although the vector \(\mathbf{v}\) is only used to predict the next token, it clearly contains residual information about the prompt tokens \(x_{1},...,x_{T}\). Since KL puts most of its weight on the highest-likelihood tokens, it can decay to zero, while much of the information remains in the low-probability tokens.