where \(\gamma _m\)  and \(\gamma _t\)  are pre-defined hyperparameter used for balancing MSE and Texture [1]}, [2]} loss functions, respectively. Detailed formulation of Texture loss function is described in Appendix C.
Thus, the collaborative distillation loss is:
\(\mathcal {L}_\text{distill}=\sum _{i=1}^{L_G}\mathbb {E}_{z \sim p(z)}\left[d(f_i(G_i^S(z)), G_i^T(z))\right] + \sum _{j=1}^{L_D}\mathbb {E}_{z \sim p(z)}\left[d(D_j^T(G^S(z)), D_j^T(G^T(z)))\right],\) 
