1. A system for presenting a three dimensional (3D) scene, comprising: at least one display; and at least one processor coupled to the at least one display; wherein the at least one processor is configured to: determine a user viewpoint based on tracking of a user position, wherein the user position comprises position and orientation in physical space; determine a user perspective relative to at least one display surface of the at least one display, wherein the user perspective comprises a mapping between angle and orientation of the at least one display surface and a render plane to the user viewpoint; render and display the 3D scene within a virtual space based on a projection in virtual space to the render plane, wherein the render plane has a correlation to the position and orientation of the at least one display, and wherein the correlation is based on the user perspective; determine a first virtual viewpoint, wherein the first virtual viewpoint is controlled by a first position, angle and orientation of at least a portion of a hand of the user in physical space without use of hand-held tools and corresponds to a first position, angle and orientation in the virtual space; determine a second virtual viewpoint, wherein the second virtual viewpoint is controlled by a second position, angle and orientation of the at least a portion of the hand of the user in physical space without use of hand-held tools and corresponds to a second position, angle and orientation in the virtual space; and establish first and second fields of view and first and second view volumes of the 3D scene, wherein the first field of view and first view volume are based on the first virtual viewpoint, and wherein the second field of view and second view volume are based on the second virtual viewpoint.