1. A method for processing a plurality of multiview videos of a scene, in which each video is acquired by a corresponding camera arranged at a particular pose, and in which a view of each camera overlaps with the view of at least one other camera, comprising the steps of: obtaining side information for synthesizing a particular view of the multiview video; synthesizing a synthesized multiview video from the plurality of multiview videos and the side information; maintaining a reference picture list for each current frame of each of the plurality of multiview videos, the reference picture indexing temporal reference pictures and spatial reference pictures of the plurality of acquired multiview videos and the synthesized reference pictures of the synthesized multiview video; and predicting each current frame of the plurality of multiview videos according to reference pictures indexed by the associated reference picture list.