Expressive capacity, also known as representation capacity, expressive power, and complexity capacity [1]}, [2]}, captures the capacity of deep learning models in approximating complex problems. Informally, the expressive capacity describes the upper bound of the complexity of any model in a family of models.
