The size of \(W\) grows quadratically with \(M\), for scenarios involving a large number of layers. An alternative approach to contain the search space size involves parameterizing \(W\) with a neural network [16; 40]. We can instead evolve a feed-forward network to output the scaling weights conditioned on the layer and step indices: \(W_{ij}=\pi_{\theta}(i,j,t)\) where \(\theta\)'s are the parameters to be evolved, whose size does not change when \(M\) grows.