1. A moving image processing apparatus for generating a frame image from a field image in a moving image, comprising: a first candidate image generation unit adapted to receive a current field image of current time and a preceding field image chronologically immediately before the current field image, generate a frame image by combining the current field image and the preceding field image as data of the same time, and output the frame image as a first candidate image; a second candidate image generation unit adapted to receive the current field image of the current time and a succeeding field image chronologically immediately after the current field image, generate a frame image by combining the current field image and the succeeding field image as data of the same time, and output the frame image as a second candidate image; a third candidate image generation unit adapted to receive the current field image, generate a frame image by pixel interpolation processing for the current field image, and output the frame image as a third candidate image; a determination unit adapted to determine whether the current field image has continuity to the preceding field image or continuity to the succeeding field image, or no continuity with any of the preceding field image and the succeeding field image; a storage unit adapted to store, based on a determination result of said determination unit, the determination result of the current field image as log information; a detection unit adapted to detect a specific pattern from a pattern of log information of continuous field images before the current field image, the log information being stored in said storage unit; and a selection unit adapted to select one of the first candidate image, the second candidate image, and the third candidate image as a frame image of the current field image based on a detection result of said detection unit.