1. An image processing apparatus comprising: a silhouette extractor to extract a silhouette image of a target object from an input depth image; and a first calculator to determine a location of at least one limb of the target object and a location of at least one joint of the target object by applying a rectangle fitting algorithm with respect to the silhouette image.