Our near perfect extraction has one exception: GPT-2 Small. On this 768 dimensional model our attack reports a hidden dimension of 757. In Appendix A we show that this "failure" is caused by GPT-2 actually having an effective hidden dimensionality of \(757\) despite having \(768\) dimensions.