Breaking symmetry with quantized weights.Large production models are typically stored "quantized", where each weight is represented in just 4 or 8 bits. In principle, this quantization could allow an adversary to recover a nearly bit-for-bit copy of the matrix \(\mathbf{W}\): while there exist an infinite number of matrices \(\mathbf{W}\cdot\mathbf{G}\), only one will be discretized properly. Unfortunately, this integer-constrained problem is NP-hard in general (similar problems are the foundation for an entire class of public key cryptosystems). But this need not imply that the problem is hard on all instances.