1. An image taking apparatus, comprising: an image taking mode switching device which switches between a multi-viewpoint image taking mode that takes a subject image that is viewed from a plurality of viewpoints and a single viewpoint image taking mode that takes a subject image that is viewed from a single viewpoint; an image taking mode detection device which detects an image taking mode that is switched to by the image taking mode switching device; an image pickup device which acquires a multi-viewpoint image or a single viewpoint image that is taken in an image taking mode that is switched to by the image taking mode switching device; a recording device which records a multi-viewpoint image or a single viewpoint image acquired with the image pickup device on a recording medium; and a protection setting device which, in a case where the multi-viewpoint image taking mode is detected by the image taking mode detection device, sets a protection with respect to a multi-viewpoint image that is recorded by the recording device so that the multi-viewpoint image is not changed or deleted.