1. A focusing apparatus comprising: a detection unit configured to detect an object from a captured image; a setting unit configured to set an auto-focus area in the captured image to an area corresponding to the detected object; a focus detection unit configured to acquire an auto-focus evaluation value, which indicates a focus state of an object image, based on an output signal from the set auto-focus area; and a determination unit configured to determine a direction to move a focus lens to focus on the detected object and to increase the auto-focus evaluation value of the detected object, wherein, when a plurality of objects are detected by the detection unit, the determination unit conducts direction determination from the present position of the focus lens to determine whether the direction to increase the auto-focus evaluation value is a closest distance direction or an infinite distance direction for each of a plurality of auto-focus areas, and performs focus adjustment by moving the focus lens in the direction which has been determined to increase the auto-focus evaluation value for the largest number of the auto-focus areas.