The decision of whether a certain biased annotation poses a problem EC2, needs to be supported by the visualization design through embedding the correlation information with the label data G3.
To support decision makers in this process, our visualizations always communicate which annotation, metric, and configuration a bias belongs to (fig:application C).
To keep the user informed about the label of investigation, we employ a tabular format for displaying label information, using vertical position for the labels at display, and horizontal positions for the metrics of interest, which domain experts are familiar with based on their previous use of spreadsheets.
Within each row of this visualization, we display the different configurations for each metric.
For all of these variables, we follow the guidelines of perceptual rankings for visualizing nominal data and employ a positional encoding [1]}.
