1. A method for encoding video data by an encoder, the method including: receiving, by the encoder, the video data including frames; determining, by the encoder, at least one temporal structure based on a series of consecutive frames in the video data, the at least one temporal structure including a sub-block of video data from each frame in the series, wherein each frame in the series is divided into a plurality of blocks, wherein the sub-block of video data from each frame in the series corresponds to one of the respective plurality of blocks; obtaining, by the encoder, a measurement matrix corresponding to spatial and temporal variations of the video data within the at least one temporal structure, the measurement matrix including a set of measurement bases having pixel values of a particular type; and generating, by the encoder, a set of measurements by applying the measurement matrix to the at least one temporal structure, the set of measurements being coded data representing the at least one temporal structure.