1. An apparatus for tracking a hand, the apparatus comprising: a skin color image detector for detecting a skin color image from an image input from an image device using a predetermined skin color of a user; a face tracker for tracking a face using the skin color image detected by the skin color image detector; a motion detector for setting a region of interest (ROI) using location information of the face tracked by the face tracker, and detecting a motion image from the set ROI; a candidate region extractor for extracting a candidate region with respect to a hand of the user using the skin color image detected by the skin color image detector and the motion image detected by the motion detector; and a hand tracker for tracking a location of the hand in a candidate region extracted by the candidate region extractor to find out a location of the hand.