1. A method of rendering a synthetic object onto a user-worn display showing the user's view of a real world scene, the method comprising the steps of: capturing real world scene information using one or more user-worn sensors; producing a pose estimation data set and a depth data set based on at least a portion of the captured real world scene information; receiving the synthetic object generated in accordance with the pose estimation data set and the depth data set; and rendering the synthetic object onto the user-worn display in accordance with the pose estimation data set and the depth data set, thereby integrating the synthetic object into the user's view of the real world scene.