In this work, we use one Bidirectional-LSTM (Bi-LSTM) layer with 256 hidden states which calculates \(h_{t}\)  using the memory block from both forward and backward directions. For faster inference, we use LSTM with recurrent projection layer [1]} to decrease the computational complexity. The projection layer projects the hidden state to a lower dimension of 96 at every time step.
