1. A system for presenting a three dimensional (3D) scene, comprising: at least one display; and at least one processor coupled to the at least one display; wherein the at least one processor is configured to: determine a user viewpoint based on tracking of a user position, wherein the user position comprises position and orientation in physical space; determine a user perspective relative to at least one display surface of the at least one display, wherein the user perspective comprises a mapping between angle and orientation of the at least one display surface and a render plane to the user viewpoint; render and display the 3D scene within a virtual space based on a projecting in virtual space to the render plane, wherein the render plane has a correlation to the position and orientation of the at least one display, and wherein the correlation is based on the user perspective; determine first and second virtual viewpoints corresponding to first and second positions, angles and orientations in the virtual space, wherein the first and second virtual viewpoints are based on first and second positions, angles and orientations of at least a portion of a hand of the user in the physical space without use of hand-held tools; and establish first and second fields of view and first and second view volumes of the 3D scene based on the first and second virtual viewpoints.