We prove Theorem REF  in section REF . In addition, we provide a procedure to find the optimal number of layers that draws from [1]}, and we apply our findings to a stochastic version of the feedforward neural network with ReLU activation studied in [2]}.
