Experimental setting. Following [1]}, the Faster RCNN-R50 and RetinaNet-R50 are trained with a 2\(\times \)  schedule for 24 epochs. To illustrate the generality of our approach, we also report the results of our distillation strategy used in conjunction with FKD [1]}, one of the current best detector-to-detector distillation methods. Note that, while preparing this work, we also noticed the concurrent work of [3]}, whose DeFeat method also follows a detector-to-detector distillation approach, and thus could also be complemented with out strategy.
<TABLE>