In contrast to standard sequenceto-sequence models <cite>(Cho et al., 2014</cite>; Sutskever et al., 2014; Bahdanau et al., 2015) , HREDs model the dialogue context by introducing a context Recurrent Neural Network (RNN) over the encoder RNN, thus forming a hierarchical encoder.