The conventional DL solutions for sequence data analysis are based on Recurrent Neural Networks (RNNs) [1]}, [2]}, [3]}. For instance, Cho et al. [3]}, introduced an Encoder-Decoder (EnDec) RNN architecture for translating phrases from one language to another language.
However, the vanilla RNNs face a major problem of vanish gradient due to repeated recurrent connections and recursive derivative computation for backpropagation through time (BTT) during training. This problem makes the RNNs difficult to be trained on data with long-term dependencies, like the data in this work.
