Previous work based on coverage based approaches<cite> (Tu et al., 2016</cite>; See et al., 2017) either imposed an extra term to the loss function or used an extra vector to keep track of which parts of the input sequences had been attended to, thereby focusing the attention weights in subsequent steps on tokens that received little attention before.