1. One or more computer storage media storing computer-useable instructions that, when used by a computing device, cause the computing device to perform a method for distilling from multi-task networks, the method comprising: training more than one single-task network with heterogeneous labels, the networks trained on images from one or more social networks; training a distilling network, the distilling network approximating the single-task networks on a common ranking task; and utilizing the distilling network to predict tags to associate with a test image or identify similar images to the test image.