1. A speech communication system with a function to have conversation with a conversation partner, comprising: speech recognition means for recognizing speech of the conversation partner; conversation control means for controlling conversation with the conversation partner based on a recognition result of the speech recognition means; image recognition means for recognizing a face of the conversation partner; and tracking control means for tracking existence of the conversation partner based on one or both of a recognition result of the image recognition means and a recognition result of the speech recognition means, wherein the conversation control means continues the conversation in keeping with tracking of the tracking control means.