We implemented the HM-AN in the platform of Theano [1]} and all the experiments were conducted on a server embedded with a Titan X GPU. In our experiments, the HM-AN is a three layer stacked RNN. The outputs are concatenated by hidden states from three layers and forwarded to a softmax layer.
