Methods To see how our fully-unsupervised method compares with methods that require (some) cross-lingual supervision, we follow [Conneau et al., 2018] and consider a simple but strong baseline consisting of solving a Procrustes problem directly using the available cross-lingual embedding pairs.