Voxel-based formulation is a natural way to represent 3D geometry. Similar to the usage of pixel (i.e. 2D element) in images, voxel is a volume element in a three-dimensional space. Previous works have explored to use multiple input views, to reconstruct the volumetric representation of scene [1]}, [2]} and objects [3]}. For example, SurfaceNet [1]} learns to predict the confidence of a voxel to determine whether it is on surface or not, and reconstruct the 2D surface of a scene. RayNet [2]} reconstructs the scene geometry by extracting view-invariant features while imposing geometric constraints. Recent works focus on generating high-resolution 3D volumetric models [6]}, [7]}. For example, Tatarchenko et al. [7]} designed a convolutional decoder based on octree-based formulation to enable scene reconstruction in much higher resolution. Other work can be found on scene completion from RGB-D data [9]}, [10]}.
One limitation of voxel representation is the high computational requirement, especially when attempting to reconstruct a scene in high resolution.
