1. A method for generating video analytics at a video encoder, comprising: encoding a video frame using macroblock-based video encoding process to obtain an encoded version of the video frame; and generating video analytics metadata (VAMD) for each of a plurality of macroblocks processed while encoding the video frame.