We employ our transformation on several datasets of different vision tasks to validate its advantages and generalization ability.
The implementation of knowledge distillation methods are from their source code except FitNets[1]}, and we reproduced FitNets for comparison.
<TABLE>