1. A handwriting recognition system with a plurality of input modes, comprising: a storage unit for storing a plurality of character fonts, each of the character fonts corresponding to at least one of the input modes; a touch screen display unit, comprising an input panel, wherein the input panel has at least two input areas located thereon, each of the areas for inputting data in one of the input modes; and a processing unit configured to conduct judging an input set of touch signals to recognize a character input by handwriting in one of the input modes, according to a position on which of the input areas, with the position corresponding to at least one of the set of touch signals, and the character being represented by the set of touch signals; wherein the touch screen display unit further comprises a display panel, and the processing unit is configured to conduct displaying at least one of the recognized characters, upon recognizing the characters, on the display panel in an order of descending frequencies respectively with which the characters were input.