1. A system for low latency stabilization of a head-worn display, the system comprising: a low latency pose tracker, including: at least one rolling-shutter camera that captures a 2D image by exposing each row of a frame at a later point in time than a previous row and outputs image data row by row; a tracking module for receiving image data row by row from the at least one camera and generating a local appearance manifold, using the local appearance manifold to track camera movements, and producing a pose estimate; and a rendering unit for: receiving pose estimates from the tracking module; using the pose estimates to predict a future pose at a time a pixel will be drawn, the pixel being a part of an augmented reality image to be displayed; and rendering the pixel just before the pixel is drawn.