1. One or more computer-storage media comprising computer executable instructions that configure one or more processors to perform a method comprising: utilizing one or more computers to split a scene into one or more coherent layers, wherein: each coherent layer of the scene has a corresponding plane equation to represent a local geometry of that coherent layer; and the one or more coherent layers in combination represent a single plane of the scene; propagating boundaries of the coherent layers across a plurality of frames corresponding to the scene; refining the splitting to present a virtual view of the scene; and rendering the coherent layers with a corresponding background layer to present the virtual view of the scene, wherein the background layer is provided by combining a plurality of under-segmented regions.