et al., 2023). Another line of research centers on the self-attention layer, examining its connection to reasoning Hou et al. (2023); Stolfo et al. (2023); Friedman et al. (2023) by contrasting the reasoning tree based on attention weights.