1. An image processing apparatus comprising: a specific color determination unit configured to divide a picture contained in an input image into a plurality of regions and determine whether each of the regions includes a specific color; a storage unit configured to store a determination result of each region determined by the specific color determination unit; and a specific region determination unit configured to determine, according to the determination result of each region stored in the storage unit, a specific region to be subjected to predetermined image processing comprising a specific color region which includes the specific color and a non-specific color region in which the specific color regions are present in upper side, left side and right side in the picture, wherein the non-specific color region does not include the specific color.