@inproceedings{gallipoli-etal-2024-keyword,
    title = "Keyword-based Annotation of Visually-Rich Document Content for Trend and Risk Analysis Using Large Language Models",
    author = "Gallipoli, Giuseppe  and
      Papicchio, Simone  and
      Vaiani, Lorenzo  and
      Cagliero, Luca  and
      Miola, Arianna  and
      Borghi, Daniele",
    editor = "Chen, Chung-Chi  and
      Liu, Xiaomo  and
      Hahn, Udo  and
      Nourbakhsh, Armineh  and
      Ma, Zhiqiang  and
      Smiley, Charese  and
      Hoste, Veronique  and
      Das, Sanjiv Ranjan  and
      Li, Manling  and
      Ghassemi, Mohammad  and
      Huang, Hen-Hsen  and
      Takamura, Hiroya  and
      Chen, Hsin-Hsi",
    booktitle = "Proceedings of the Joint Workshop of the 7th Financial Technology and Natural Language Processing, the 5th Knowledge Discovery from Unstructured Data in Financial Services, and the 4th Workshop on Economics and Natural Language Processing",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2024.finnlp-1.13",
    pages = "130--136",
    abstract = "In the banking and finance sectors, members of the business units focused on Trend and Risk Analysis daily process internal and external visually-rich documents including text, images, and tables. Given a facet (i.e., topic) of interest, they are particularly interested in retrieving the top trending keywords related to it and then use them to annotate the most relevant document elements (e.g., text paragraphs, images or tables). In this paper, we explore the use of both open-source and proprietary Large Language Models to automatically generate lists of facet-relevant keywords, automatically produce free-text descriptions of both keywords and multimedia document content, and then annotate documents by leveraging textual similarity approaches. The preliminary results, achieved on English and Italian documents, show that OpenAI GPT-4 achieves superior performance in keyword description generation and multimedia content annotation, while the open-source Meta AI Llama2 model turns out to be highly competitive in generating additional keywords.",
}

In the banking and finance sectors, members of the business units focused on Trend and Risk Analysis daily process internal and external visually-rich documents including text, images, and tables. Given a facet (i.e., topic) of interest, they are particularly interested in retrieving the top trending keywords related to it and then use them to annotate the most relevant document elements (e.g., text paragraphs, images or tables). In this paper, we explore the use of both open-source and proprietary Large Language Models to automatically generate lists of facet-relevant keywords, automatically produce free-text descriptions of both keywords and multimedia document content, and then annotate documents by leveraging textual similarity approaches. The preliminary results, achieved on English and Italian documents, show that OpenAI GPT-4 achieves superior performance in keyword description generation and multimedia content annotation, while the open-source Meta AI Llama2 model turns out to be highly competitive in generating additional keywords.
Gallipoli, Giuseppe Papicchio, Simone Vaiani, Lorenzo Cagliero, Luca Miola, Arianna Borghi, Daniele
Keyword-based Annotation of Visually-Rich Document Content for Trend and Risk Analysis Using Large Language Models