1. A computer-implemented method comprising: receiving audio data that encodes an utterance of a user; determining that the user has been classified as a novice user of a speech recognizer, comprising determining that an amount of training data that has been collected for the user does not satisfy a threshold; in response to determining that the user has been classified as a novice user of a speech recognizer, selecting a speech recognizer setting that is used by the speech recognizer in generating a transcription of the utterance, wherein the selected speech recognizer setting is different than a default speech recognizer setting that is used by the speech recognizer in generating transcriptions of utterances of users that are not classified as novice users, and wherein the selected speech recognizer setting results in increased speech recognition accuracy for the utterance in comparison with the default setting, and wherein the selected speech recognizer setting results in increased speech recognition latency for the utterance in comparison with the default setting; and obtaining a transcription of the utterance that is generated by the speech recognizer using the selected speech recognizer setting.