Recently, model complexity in deep learning has attracted more and more attention [1]}, [2]}, [3]}, [4]}, [5]}, [6]}. However, to the best of our knowledge, there is no existing survey on model complexity in deep learning. The lack of survey on this emerging and important subject motivates us to conduct this survey of the latest studies. In this article, we use the terms “deep learning model” and “deep neural network” interchangeably.
