Meaningful evaluation of automated dialogue system performance has long been recognized as crucial to progress in dialogue system research
[1]} and is an active area of development, including the recent introduction of the `sensibleness and specificity' metric of [2]}.
Since the introduction of bot-building platforms as described in Section , it has also become a daily concern for
customer service bot-builders.
