The Transformer decoder generates the output sequence from \(\bar{\mathbf {H}}\) . Our copy mechanism is incorporated into the encoder rather than copying the input words during the decoding steps [1]}, [2]}. Unless otherwise specified, we use the average copy ratio of the training dataset, 0.7, for our experiments.
