We evaluate VIZ-plots in a user study to answer RQ3 and RQ4 with 41 participants from OurCompany, all of whom are data scientists or analysts.
To emulate a realistic setting that our users are familiar with, we generate VIZ explanations for a model trained on a store sales dataset from OurCompany.
We use a human-grounded evaluation [1]}: a simplified task to assess whether users can make sense of the VIZ-explanations, and whether they allow users to recognize untrustworthy predictions.
Here, the task is to predict store sales based on five input variables (see Figure REF ).
The user study consists of two parts, namely an objective and subjective evaluation of RETRO-VIZ.
