1. An image processing device comprising: a unit configured to acquire a pixel block contacting an enclosing border of a character rectangle extracted from an image; a determination unit configured to determine whether or not the acquired pixel block has a likelihood of noise; a unit configured to generate a noise candidate removed character rectangle by removing from the character rectangle the pixel block as to which it is determined to have the likelihood of noise; and an outputting unit configured to assess validities by performing character recognition for both of the noise candidate removed character rectangle and the character rectangle, and to output a recognition result for one of those rectangles with a greater validity assessed.