@inproceedings{
chaleshtori2023on,
title={On Evaluating Explanation Utility for Human-{AI} Decision-Making in {NLP}},
author={Fateme Hashemi Chaleshtori and Atreya Ghosal and Ana Marasovic},
booktitle={XAI in Action: Past, Present, and Future Applications},
year={2023},
url={https://openreview.net/forum?id=8BR8EaWNTZ}
}
Is explainability a false promise? This debate has emerged from the lack of consistent evidence that explanations help in situations they are introduced for. In NLP, the evidence is not only inconsistent but also scarce. While there is a clear need for more human-centered, application-grounded evaluations, it is less clear where NLP researchers should begin if they want to conduct them. To address this, we introduce evaluation guidelines established through an extensive review and meta-analysis of related work.
On Evaluating Explanation Utility for Human-AI Decision-Making in NLP
Fateme Hashemi Chaleshtori Atreya Ghosal Ana Marasovic