On COCO, the loss weight we used for \(L_2\)  loss is set to be \(10^{-4}\)  to balance with task loss.
And following [1]}, we apply distillation methods before ReLU at the end of the last layer block.
