Because of the complex, over-parameterized architectures, deep learning models usually have high expressive capacity [1]}, [2]}. However, a series of studies [3]}, [4]}, [5]} find that the effective complexity of a trained deep model may be much lower than the expressive capacity.
