1. A method of reconstructing a three-dimensional (3D) facial shape, the method comprising: designating a target frame to be used for 3D reconstruction from among a plurality of frames including a front facial image; recognizing a facial region in each of the plurality of frames and at least one feature point region in the facial region; warping frames remaining after excluding the target frame from among the plurality of frames, to match a facial region and at least one feature point region in each of the remaining frames with a facial region and at least one feature point region of the target frame, respectively; magnifying the facial regions of the target frame and the warped remaining frames to a size corresponding to a super resolution higher than that of the front facial image; dividing each of the magnified facial regions of the target frame and the warped remaining frames into a plurality of unit patches; and acquiring a super-resolution facial image for 3D facial shape reconstruction by deforming all pixels forming the facial region of the target frame based on similarities between unit patches of the target frame and unit patches of each of the remaining frames.