Our sequence-to-sequence models are conformer-based [1]} encoder-decoder models trained in EspNet [2]}.
The configuration is similar to the ones described in [3]}.
The encoder has 12 layers with four attention heads, an embedding dimension of 256, and a FFN dimension of 2048.
The decoder uses 6 layers with identical parameters.
In addition to the standard cross-entropy objective function, we also use the CTC objective function [4]}.
Our output units are characters.
