@inproceedings{van-nooten-kosar-2024-advancing,
    title = "Advancing {CSR} Theme and Topic Classification: {LLM}s and Training Enhancement Insights",
    author = "Van Nooten, Jens  and
      Kosar, Andriy",
    editor = "Chen, Chung-Chi  and
      Liu, Xiaomo  and
      Hahn, Udo  and
      Nourbakhsh, Armineh  and
      Ma, Zhiqiang  and
      Smiley, Charese  and
      Hoste, Veronique  and
      Das, Sanjiv Ranjan  and
      Li, Manling  and
      Ghassemi, Mohammad  and
      Huang, Hen-Hsen  and
      Takamura, Hiroya  and
      Chen, Hsin-Hsi",
    booktitle = "Proceedings of the Joint Workshop of the 7th Financial Technology and Natural Language Processing, the 5th Knowledge Discovery from Unstructured Data in Financial Services, and the 4th Workshop on Economics and Natural Language Processing",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2024.finnlp-1.33",
    pages = "292--305",
    abstract = "In this paper, we present our results of the classification of Corporate Social Responsibility (CSR) Themes and Topics shared task, which encompasses cross-lingual multi-class classification and monolingual multi-label classification. We examine the performance of multiple machine learning (ML) models, ranging from classical models to pre-trained large language models (LLMs), and assess the effectiveness of Data Augmentation (DA), Data Translation (DT), and Contrastive Learning (CL). We find that state-of-the-art generative LLMs in a zero-shot setup still fall behind on more complex classification tasks compared to fine-tuning local models with enhanced datasets and additional training objectives. Our work provides a wide array of comparisons and highlights the relevance of utilizing smaller language models for more complex classification tasks.",
}

In this paper, we present our results of the classification of Corporate Social Responsibility (CSR) Themes and Topics shared task, which encompasses cross-lingual multi-class classification and monolingual multi-label classification. We examine the performance of multiple machine learning (ML) models, ranging from classical models to pre-trained large language models (LLMs), and assess the effectiveness of Data Augmentation (DA), Data Translation (DT), and Contrastive Learning (CL). We find that state-of-the-art generative LLMs in a zero-shot setup still fall behind on more complex classification tasks compared to fine-tuning local models with enhanced datasets and additional training objectives. Our work provides a wide array of comparisons and highlights the relevance of utilizing smaller language models for more complex classification tasks.
Van Nooten, Jens Kosar, Andriy
Advancing CSR Theme and Topic Classification: LLMs and Training Enhancement Insights