1. An imaging and processing device, comprising: a separation section for separating visible light into a first color component, a second color component, and a third color component; a first imaging section for taking moving images of the first color component and the third color component, wherein the first imaging section takes images which form the moving images with a first spatial resolution and a first temporal resolution by exposure for a first charge accumulation time period; a second imaging section for taking a moving image of the second color component, wherein the second imaging section takes images which form the moving image with a second spatial resolution higher than the first spatial resolution and a second temporal resolution lower than the first temporal resolution by exposure for a second charge accumulation time period longer than the first charge accumulation time period; a control section for controlling imaging conditions of the first imaging section and the second imaging section; a first upconverter for generating a moving image of the second color component having the temporal and spatial resolutions thereof increased, based on information on the moving image of the first color component and information on the moving image of the second color component; and a second upconverter for generating moving images of the first color component and the third color component having the spatial resolutions thereof increased, based on information on the moving image of each of the first color component and the third color component and information on the moving image of the second component having the temporal and spatial resolutions thereof increased.