1. A system for providing non-visual sensory feedback to a user interacting with a virtual object, comprising: a capture device that captures data corresponding to a user location; a feedback device that provides non-visual sensory feedback to the user; and a component that predicts that a user is likely to interact with the virtual object at a future time based on at least a partial skeletal model of the user generated from the captured data; that, in response to initially predicting that the user is likely to interact with the virtual object at the future time, computes a non-visual sensory feedback for the predicted future interaction; and that indicates to the feedback device, prior to the future time, to provide the computed non-visual sensory feedback to the user at the future time.