In order to define the utilization of a computation unit mathematically, one can use the parallels drawn by Bajcsy et al. [1]} between neural network and communication fields in terms of (a) computation unit maximum representation power and channel capacity in communications and (b) computation unit utilization and channel efficiency while leveraging the universal approximation theorem [2]} and the source coding theorem [3]}.
Using the theorems, a computation unit \(v_{j}\)  with \(D_{j}^{Out}\)  nodes has the maximum representation power (or computation unit capacity) of \(n_{j} = 2^{D_{j}^{Out}}\)  possible states.
