1. A system for enabling estimating gaze of different users with respect to a scene from eye measurement points which represent un-calibrated eye measurements of the users viewing the scene, the system comprising: an input for obtaining at least a first set of eye measurement points of a first user viewing the scene, and a second set of eye measurement points of a second user viewing the scene, the first set of eye measurement points being obtained as coordinates in a first coordinate system, the second set of eye measurement points being obtained as coordinates in a second coordinate system, the first coordinate system and the second coordinate system having an unknown geometric relation; and a processing subsystem configured for: i) mutually calibrating the first set of eye measurement points and the second set of eye measurement points by mapping said points to a common coordinate system, thereby obtaining a set of mapped eye measurement points, said mapping includes establishing a coordinate transformation which provides similar coordinates in the common coordinate system for geometrically similar topologies of both sets of eye measurement points; and ii) calculating a scene transformation for mapping the common coordinate system to a coordinate system associated with the scene, said calculating includes matching eye measurement points from the set of mapped eye measurement points to interest points of the scene.