1. A display control apparatus comprising: a conversion and synthesis unit configured to convert an array of pixels constituting each of planar images for multiple view points and synthesize the planar images for the multiple view points with each other in which the array of the pixels is converted to generate a three-dimensional display image, the conversion and synthesis unit including a correspondence control unit configured to associate view point image sub pixels corresponding to sub pixels of the pixel constituting each of the planar images for the multiple view points with three-dimensional display sub pixels corresponding to sub pixels of the pixels constituting the three-dimensional display image, a sub pixel value decision unit configured to decide a value of the sub pixel before the conversion for each color of the sub pixels on the basis of the view point image sub pixel extracted from the planar image for each view point, and a sub pixel generation unit configured to obtain a value of the sub pixel after the conversion on the basis of the decided value of the sub pixel before the conversion to generate the three-dimensional display sub pixels associated with the view point image sub pixels.