Another straightforward way is to cut-off the special prefix after a fixed generation step.
This absolutely fixes the issue in a brute-force manner.
In [1]}, they also employed this method to avoid degeneration (i.e. model keep producing the same token). In this paper, we refer to this approach as `early stopping'.
