To reduce the quantization loss, we adopt GPTQ (Frantar et al., 2022) to apply weight calibration. We sample calibration data \(\mathbf{X}\) from a similar distribution of SFT data. The quantization objective is to minimize the disturbance of the quantization \(\|\mathbf{W}\mathbf{X}-dequant(\hat{\mathbf{W}})\mathbf{X}\|_{2}^{2}\).