1. A three-dimensional (3D) display apparatus comprising: an image input device which receives an image and depth information of the image; a multi-view image generator which generates a multi-view foreground image which has depth information which is less than a preset depth value, and a multi-view rear ground image which has depth information which is equal to or greater than the preset depth value, based on the received image and the received depth information of the image; a multi-view image renderer which performs rendering by arranging the multi-view foreground image according to a first arrangement pattern and arranging the multi-view rear ground image according to a second arrangement pattern; and a display which outputs the rendered multi-view image.