1. A color processing apparatus comprising: a first setting section, arranged to set a region of interest in a frame image of a moving image; a calculator, arranged to calculate an occupied area ratio indicating an amount the region of interest occupies with respect to the entire frame image in the frame image set with the region of interest; a determiner, arranged to determine a temporal increase or decrease of the occupied area ratio based on the occupied area ratios of a plurality of frame images set with the regions of interest; a second setting section, arranged to set a color processing method for each frame image based on the occupied area ratio and the temporal increase or decrease determined by the determiner; and a color processor, arranged to apply color processing to the frame image based on the color processing method set in the frame image.