1. A method comprising: determining three-dimensional (3D) geometry information for one or more physical objects in a physical environment using one or more sensors of a mobile device; recognizing 3D objects in the physical environment based on a comparison of the 3D geometry information for the one or more physical objects with 3D objects stored in a database of 3D objects; determining a field of view of the physical environment based on a position of the mobile device in the physical environment; determining a viewpoint position from which a display of the mobile device is viewed, wherein the viewpoint position is offset from normal to a surface of the display; determining a gaze direction from the viewpoint position to the display of the mobile device, wherein the gaze direction is indicative of an angle by which the viewpoint position is offset from a position that is normal to the surface of the display; rendering an image of one or more of the recognized 3D objects that are within the field of view, wherein the rendered image has a given perspective that is based on the position of the mobile device and the gaze direction from the viewpoint position to the display of the mobile device; and combining the rendered image with a live image of the field of view that is presented by the mobile device.