1. A facial recognition apparatus, comprising: a two-dimensional information acquisition unit to acquire two-dimensional image information of a subject; a three-dimensional information acquisition unit to acquire three-dimensional image information of the subject; a user information database to store an elliptical model corresponding to three-dimensional face information of a user and two-dimensional face information of the user; and a control unit to perform facial recognition using the two-dimensional image information of the subject, to determine whether a recognized face is the user's face, to match the elliptical model of the user to the three-dimensional image information to calculate an error upon determining that the recognized face is the user's face, and to determine whether the user's face is improperly used based on the error.