On the other side, for each completion candidate s we compute its representation by averaging over word2vec [18] representations of the words contributing to s. However, in contrast to the prior work <cite>[32]</cite> , instead of comparing the discrete output of the network with the representation of s, we directly optimize an objective in the embedding space.