Expressive capacity of deep models is also known as representation capacity, expressive power, and complexity capacity [1]}, [2]}. It describes how well a deep learning model can approximate complex problems. Informally, the expressive capacity describes the upper bound of the complexity in a parametric family of models.
