1. A method comprising: receiving an acoustic input signal at a speech recognizer; identifying a user that is speaking based on the acoustic input signal; determining speaker-specific information previously stored for the user; determining, by a computing device, a set of responses based on the recognized acoustic input signal and the speaker-specific information for the user; determining if the response should be output; and outputting the response if it is determined the response should be output.