I know it has been shown that RNNs are Turing complete. So for any Turing machine, there exists a configuration of a RNN that is equivalent to it.But I'm wondering, is all those configuration reachable through learning/training? i.e. For any Turing machine, does there exist a data set and a training process, which will finish in finite time and generate an equivalent RNN?
Is learned RNN still universal?
neural networks;turing completeness