For example, <cite>Bahdanau et al. [2015]</cite> use a bidirectional RNN and concatenate the forward and backward states as the hidden state of a source word to capture both forward and backward contexts.