1. A speech recognition system comprising the following computer-executable components: a receiver component that receives a distorted speech utterance; and an adaptor component in communication with the receiver component, wherein the adaptor component selectively adapts parameters of a compressed model used to recognize at least a portion of the distorted speech utterance, wherein the adaptor component selectively adapts the parameters of the compressed model based at least in part upon the received distorted speech utterance.