1. A method comprising: receiving a set of text derived from a speech-to-text translation of an audio signal; comparing the set of text to reference text to identify errors in the received set of text; producing a respective weighted value for each of the identified errors, a magnitude of each of the weighted values varying depending on a type of the translation error; and utilizing the weighted values to generate a metric indicating a level of quality of the set of text with respect to the reference text.