…methods rely on some additional and often heuristic step to generate an initial solution, such as adversarially-trained neural networks [Conneau et al., 2018, Zhang et al., 2017a,b], robust self-learning [Artetxe et al., 2018b] or
5This can be easily verified by noting that the…