1. A device configured to at least track one or more points in a video, comprising: one or more processors; memory in communication with the one or more processors that contains instructions executable by the one or more processors to cause the device to at least: obtain a first frame and a second frame of video content; match a first patch of the first frame with a second patch of the second frame, the first patch and second patch representing a region in the first frame and a region in the second frame, respectively; calculate, based at least in part on a first location of the first patch and a second location of the second patch, a translation between the first patch and second patch; locate a second point of the second frame that corresponds to a first point of the first frame by at least searching for the second point in a region of the second frame selected based at least in part on a location of the first point in the first frame and the calculated translation; and provide information identifying the located second point for use in modifying the video content based at least in part on the identified second point.