1. An image generation apparatus for generating, based on an input image and a depth map corresponding to the input image, an image of a new viewpoint of a scene represented in the input image, the apparatus comprising: a pixel-shifted image generation unit configured to generate a first pixel-shifted image and a second pixel-shifted image, the first pixel-shifted image resulting from a process of shifting, based on the input image and the depth map, a pixel in the input image by a shift amount corresponding to the new viewpoint, the second pixel-shifted image resulting from a process of shifting a pixel in a background edge image by the same shift amount as for the first pixel-shifted image, and the background edge image being included in the input image and containing a designated edge pixel that is a pixel located in a background region around an edge of a foreground object; an image fusion unit configured to fuse the second pixel-shifted image and the first pixel-shifted image to include a background region in the second pixel-shifted image into a hole that is a region having no pixel information and created in the first pixel-shifted image in the process of shifting the pixel; and a hole filling unit configured to fill the hole with pixel information based on the fused pixel-shifted image.