WOLVESAAR at SemEval-2016 Task 1: Replicating the Success of Monolingual Word Alignment and Neural Embeddings for Semantic Textual Similarity
H Bechara, R Gupta, L Tan, C Orasan, R Mitkov… - Proceedings of SemEval, 2016
... 2We use the 300 dimensions vectors from the GloVe model trained on the Commoncrawl Corpus with 840B tokens, 2.2M vocabulary. distributions p and pθ using regularised KullbackLeibler (KL) divergence. J(θ) = 1 n n ∑ i=1KL(p(i)∣ ∣ ∣ ∣ p (i) θ ) + λ2||θ||2 2 (8) ...