1. A method for scene understanding based on a sequence of image frames, comprising: converting, utilizing a first set of neurosynaptic core circuits, each pixel of each image frame to one or more corresponding neural spikes; extracting, utilizing a second set of neurosynaptic core circuits, one or more features from said sequence of image frames by processing neural spikes corresponding to pixels of said sequence of image frames; encoding, utilizing a third set of neurosynaptic core circuits, said one or more extracted features as one or more neural spikes; and classifying, utilizing said third set of neurosynaptic core circuits, said one or more extracted features; wherein each neurosynaptic core circuit comprises a plurality of electronic neurons, a plurality of electronic axons, and a synaptic crossbar array including multiple electronic synapse devices interconnecting the plurality of electronic neurons to the plurality of electronic axons.