1. An information processing device that carries out word or phrase recognition from an image, the information processing device comprising: an image capturing section that captures a moving image; extraction means for (i) successively obtaining consecutive images that constitute the moving image captured by the image capturing section and (ii) extracting word and phrase information being information indicative of a word or a phrase at a predetermined position of the image; a storage section that stores the word and phrase information extracted by the extraction means; determining means for determining, as a recognition result, a word or a phrase of a piece of the word and phrase information that is stored by the most number in the storage section, wherein the storage section can store the word and phrase information to a predetermined number of pieces, and input to and output from the storage section of the word and phrase information is set so that the word and phrase information stored in the storage section is taken out in an order of earlier stored; and a list information storage device that stores list information, the list information being a list of pieces of word and phrase information each indicative of a word or a phrase extracted from an image, wherein the extraction means extracting, with reference to the list information, the word and phrase information of a word or a phrase at the predetermined position from the image constituting the moving image captured by the image capturing section.