1. A method for processing interactive user control for a view of a scene displayed on a virtual window, comprising: identifying a head of a user that is to interact with the scene; storing an initial frame of user image data representing the head of the user, said view of the scene comprises a view-frustum initially defined by a gaze projection of a location of the head through outer edges of the virtual window when the location of the head is substantially normal to about a center point of the virtual window; tracking the identified head of the user during display of the scene, the tracking enabling detection of a change in location of the head of the user, the tracking including, identifying a search region within a frame of the user image data; and comparing values within the search region to template values of the stored initial frame of image data; adjusting the view-frustum in accordance with the change in location of the head of the user, the adjusting of the view-frustum being in response to tracking a move in the location of the head away from normal relative to the center point of the virtual window, the adjusted view-frustum defined by an updated gaze projection of the changed location of the head through the outer edges of the virtual window, such that the view-frustum moves in a direction opposite to the move in the location of the head; adjusting a scale of the scene according to a change in a distance of the head of the user from a capture device; and repeating the identifying the search region, the comparing, and the adjusting for successive frames of the scene, wherein the comparing is performed with the stored initial frame of image data.