1. Computer-readable storage hardware storing information to enable one or more devices that process and transmit multi-view video to perform a method, the method comprising: receiving video streams of a real world scene, the video streams concurrently captured by respective cameras comprising a first camera and a second camera, the video streams comprising a first video stream captured by the first camera and a second video stream captured by the second camera; receiving different viewpoints corresponding to positions of viewing a rendering of the multi-view video at respective times; computing first compression rates for the first video stream and second compression rates for the second video stream by modelling in at least two dimensions the viewpoints relative to the positions and directions of the first and second cameras and modelling the positions and directions of the first and second cameras relative to each other, the first compression rates corresponding to the viewpoints, respectively, and the second compression rates corresponding to the viewpoints, respectively, wherein the viewpoints correspond to positions of a remote viewer; compressing the first video stream according to the first compression rates, and compressing the second video stream according to the second compression rates, respectively, wherein the multi-view video comprises the compressed first video stream and the compressed second video stream; and transmitting the compressed first video stream and the compressed second video stream, which comprise the multi-view video, via a network to a remote terminal that receives the video streams, synthesizes the video streams into a synthetic video stream, and displays the synthetic video, wherein the displayed synthetic video stream comprises the rendering of the multi-view video.