1. A dialog system training environment comprising: a user simulator that provides a text to speech output associated with an utterance; and, a dialog system that comprises: a speech model having a plurality of modifiable parameters, the speech model receives the speech input from the utterance and produces output features; and, a dialog action model having a plurality of modifiable parameters, the dialog model receives the speech output features from the speech model and produces output actions. parameters of the speech model and/or the dialog action model based, at least in part, upon the utterance identified by the speech model and/or the action taken by the dialog action model.