@inproceedings{zinova-etal-2024-interaction,
    title = "Interaction of Semantics and Morphology in {R}ussian Word Vectors",
    author = "Zinova, Yulia  and
      van de Vijver, Ruben  and
      Yablokova, Anastasia",
    editor = "Zock, Michael  and
      Chersoni, Emmanuele  and
      Hsu, Yu-Yin  and
      de Deyne, Simon",
    booktitle = "Proceedings of the Workshop on Cognitive Aspects of the Lexicon @ LREC-COLING 2024",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "ELRA and ICCL",
    url = "https://aclanthology.org/2024.cogalex-1.14",
    pages = "120--128",
    abstract = "In this paper we explore how morphological information can be extracted from fastText embeddings for Russian nouns. We investigate the negative effects of syncretism and propose ways of modifying the vectors that can help to find better representations for morphological functions and thus for out of vocabulary words. In particular, we look at the effect of analysing shift vectors instead of original vectors, discuss various possibilities of finding base forms to create shift vectors, and show that using only the high frequency data is beneficial when looking for structure with respect to the morphosyntactic functions in the embeddings.",
}

In this paper we explore how morphological information can be extracted from fastText embeddings for Russian nouns. We investigate the negative effects of syncretism and propose ways of modifying the vectors that can help to find better representations for morphological functions and thus for out of vocabulary words. In particular, we look at the effect of analysing shift vectors instead of original vectors, discuss various possibilities of finding base forms to create shift vectors, and show that using only the high frequency data is beneficial when looking for structure with respect to the morphosyntactic functions in the embeddings.
Zinova, Yulia van de Vijver, Ruben Yablokova, Anastasia
Interaction of Semantics and Morphology in Russian Word Vectors