1. An image decoding apparatus which performs decoding while predicting an image between different views using a reference image decoded for a view different from a decoding target image and a reference depth map which is a depth map for an object of the reference image when the decoding target image is decoded from encoded data of a multi-view image including images of a plurality of different views, the image decoding apparatus comprising: a reference depth region setting unit configured to set a reference depth region which is a corresponding region on the reference depth map for decoding target regions into which the decoding target image is divided; and an inter-view prediction unit configured to generate an inter-view predicted image for the decoding target region from the reference image using depth information in the reference depth region as depth information for the decoding target region.