1. A method of tracking an object included in a frame image comprising: storing a template image of an object to be a track target; receiving a frame image in a time series; setting a search region of the object in a frame image at a present point in time, when a zoom scaling factor of the frame image at the present point in time is different from a zoom scaling factor of a frame image at a previous point in time, based on an object region in the frame image at the previous point in time, zoom center coordinates in the frame image at the previous point in time, and a ratio between the zoom scaling factor of the frame image at the previous point in time and the zoom scaling factor of the frame image at the present point in time; normalizing an image of the search region of the object included in the frame image at the present point in time to a fixed size; and searching the normalized image of the search region for an object region similar to the template image.