As examples of some of the challenges of adapting seq2seq models to low resource conditions, the WER of seq2seq systems on BABEL languages in [1]}, [2]} are 10-20% absolute worse than competitive hybrid models in [3]}, and the WER of seq2seq systems on low-resource Indian languages in [4]} is 10% absolute worse than the hybrid baseline in [5]}.
All of [1]}, [2]}, [4]} contain compelling and valuable work on low resource learning with seq2seq models, but this comparison highlights the difficulty in using seq2seq models in such conditions compared to hybrid models.
