1. An image recognizing apparatus that has an image recognizing unit that recognizes recognition objects in an image and sequentially gives the right of use of the image recognizing unit to a plurality of client apparatuses that have requested the right of use, comprising: a registering unit adapted to register designating information designating recognition objects in an image and the number of recognition objects as a recognition termination condition for terminating the recognition, which are transmitted from each of the client apparatuses that have requested the right of use, in association with each of the client apparatuses; and a managing unit adapted to cause the image recognizing unit to carry out recognition based on the registered number of recognition objects for the client apparatus given the right of use and carry out control to change the right of use to the next client apparatus when the number of recognition objects, which is registered in association with the client apparatus given the right of use, have been recognized by the image recognizing unit.