Student's t–Test [1]} was used as a metric similar to other studies [2]}, [3]}, [4]} to evaluate the statistical significance of differences in ranking and orthogonality of each configuration. We assumed on the null hypothesis that the mean values of the impact set sizes for all configuration were equal. Additionally, we leveraged standard ranked-based metrics similar to other studies [5]}, [6]}, [7]} to enable a clear-cut comparisons among various approaches/configurations. Specifically, we measured mean average precision (MAP) and mean reciprocal rank (MRR) [8]}. MAP considers average rank position of each relevant comment; MRR considers average position of the first relevant comment in the ranked list.
