@inproceedings{armaselu-etal-2024-self,
    title = "Self-Evaluation of Generative {AI} Prompts for Linguistic Linked Open Data Modelling in Diachronic Analysis",
    author = "Armaselu, Florentina  and
      Liebeskind, Chaya  and
      Valunaite Oleskeviciene, Giedre",
    editor = "S{\'e}rasset, Gilles  and
      Oliveira, Hugo Gon{\c{c}}alo  and
      Oleskeviciene, Giedre Valunaite",
    booktitle = "Proceedings of the Workshop on Deep Learning and Linked Data (DLnLD) @ LREC-COLING 2024",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "ELRA and ICCL",
    url = "https://aclanthology.org/2024.dlnld-1.8",
    pages = "86--91",
    abstract = "This article addresses the question of evaluating generative AI prompts designed for specific tasks such as linguistic linked open data modelling and refining of word embedding results. The prompts were created to assist the pre-modelling phase in the construction of LLODIA, a linguistic linked open data model for diachronic analysis. We present a self-evaluation framework based on the method known in literature as LLM-Eval. The discussion includes prompts related to the RDF-XML conception of the model, and neighbour list refinement, dictionary alignment and contextualisation for the term revolution in French, Hebrew and Lithuanian, as a proof of concept.",
}

This article addresses the question of evaluating generative AI prompts designed for specific tasks such as linguistic linked open data modelling and refining of word embedding results. The prompts were created to assist the pre-modelling phase in the construction of LLODIA, a linguistic linked open data model for diachronic analysis. We present a self-evaluation framework based on the method known in literature as LLM-Eval. The discussion includes prompts related to the RDF-XML conception of the model, and neighbour list refinement, dictionary alignment and contextualisation for the term revolution in French, Hebrew and Lithuanian, as a proof of concept.
Armaselu, Florentina Liebeskind, Chaya Valunaite Oleskeviciene, Giedre
Self-Evaluation of Generative AI Prompts for Linguistic Linked Open Data Modelling in Diachronic Analysis