Effective model complexity, also known as practical complexity, practical expressivity, and usable capacity [1]}, [2]}, reflects the complexity of the functions represented by deep models with specific parameterization [3]}. The effective model complexity is for a model with parameters fixed. The study of effective model complexity helps the exploration of various aspects of deep models, such as understanding the optimization algorithms [2]}, improving model selection strategies [5]} and improving model compression [6]}.
