1. A multi-viewpoint image display device comprising: a display configured to provide a multi-view that comprises a plurality of views; a tracker configured to track a position of a face of a user according to a shifting position of the user; and a controller configured to shift positions of the multi-view and to provide a shifted multi-view so that first and second target views of the multi-view are provided as left-eye and right-eye views of the user and first and second target images of the plurality of views are provided as left-eye and right-eye images of the user, based on the tracked position of the user's face, wherein the plurality of views comprises the first and second target views, wherein the controller is configured to replace the first target view and remaining target views positioned in a same direction as the first target view with a first target image positioned in the same direction as the first target view, and replace the second target view and remaining target views positioned in a same direction as the second target view with a second target image positioned in the same direction as the second target view, wherein the first target image and the second target image are sub-views of the plurality of views.