An Intuitive Explanation of Knowledge Distillation
What is distillation? And why does it work? With the increasing use of deep learning in many tasks, the network’s size, computation, memory, and power requirements are surging simultaneously. Consequently, they fail to run on edge devices with limited computing resources. Hence, the need for model compression surfaces. One such…
An Intuitive Explanation of Knowledge Distillation What is distillation? And why does it work? With the increasing use of deep learning in many tasks, the network’s size, computation, memory, and power requirements are surging simultaneously. Consequently, they fail to run on edge devices with limited computing resources. Hence, the need for model compression surfaces. One such… deep-learning
Intuitive Explanation Knowledge Distillation distillation work increasing use deep learning many task network’s size computation memory power requirement surging simultaneously Consequently fail run edge device limited computing resource Hence need model compression surface One such… deeplearning