**Method:** Let \(\mathbf{Q}\) be as defined in Algorithm 1. Now rewrite \(\mathbf{Q}=\mathbf{U}\cdot\mathbf{\Sigma}\cdot\mathbf{V}^{\top}\) with SVD. Previously we saw that the number of large enough singular values corresponded to the dimension of the model. But it turns out that the matrix \(\mathbf{U}\) actually directly represents (a rotation of) the final layer! Specifically, we can show that \(\mathbf{U}\cdot\mathbf{\Sigma}=\mathbf{W}\cdot\mathbf{G}\) for some \(h\times h\) matrix \(\mathbf{G}\) in the following lemma.