1. An apparatus of scanning and recognizing characters, comprising: an optical sensor for capturing images, the optical sensor continuously capturing scanned characters to obtain an image frame sequence containing the scanned characters, each image frame in the image frame sequence containing contents being partially overlaps with content of its previous one frame; and a controller for processing images and recognizing characters, according to the overlapping contents, the controller dividing the image frames in the image frame sequence into groups of image frames in which each group includes a reference frame, a predictive frame and optionally some skip frame, and combining the reference frame and the predictive frame to a panorama image group by group, performing an inclination correction based on the panorama image and performing a character recognition to get the character codes of the scanned characters, wherein the controller is further configured for: setting a frame attribution of the current frame in the image frame sequence to form groups of image frames, which includes the reference frame, the predictive frame and the skip frame, the reference frame is a first frame of one group of image frames, the skip frames are the image frame between the reference frame and the predictive frame, the numbers of the skip frame is determined by the overlapping contents among the image frames, and the predictive frame is a last frame in one group of image frames; calculating a predictive value of the combining information for the current frame according to an updated value of the combining information for a previous image frame which has a combining information, if the frame attribution of the current frame is a reference frame or a predictive frame; evaluating candidate values of the combining information for the current frame according to the predictive value of the combining information for the current frame, to obtain a calculating value of the combining information for the current frame; calculating an updating value of the combining information for the current frame according to the calculating value of the combining information for the current frame and turning to the setting unit until the updating value of the combining information for all the reference frame and predictive frames in the image frame sequence have been calculated; and combining image frames to a panorama image according to the calculating value of the combining information for the respective reference frame and predictive frame.