We use three metrics to evaluate the performance of the rankings, namely: MAP (see Section REF ), SRCC (Spearman Rank Correlation Coefficient) [1]}, and MRR (Mean Reciprocal Rank) [2]}. SRCC measures the correlation between the rankings created by ST-Rank (and also by AHP and WAM) against the reference rankings created by the senior JS developers. In particular, we calculated SRCC for each ranking and then averaged them to obtain a value that summarizes the “stability" of each technique. MRR, in turn, evaluates if the highest-ranked items are relevant. The closer the MRR value is to 1, the greater the number of relevant technologies in the highest positions.
