1. An information processing apparatus that can recognize an operation caused by a recognition target, comprising: a detection unit configured to detect a moving member moving in a background area and including an object other than the recognition target; a setting unit configured to set a partial area of partial areas constituting the background area as a background undetermined area if the moving member detected by the detection unit is present in the background area, and further configured to set a partial area as a background determined area if it is regarded that the recognition target is not present in the background area in each of the partial areas set as the background undetermined area; and a recognition unit configured to recognize an operation caused by the recognition target that moves in the background determined area.