1. A method comprising: electronically receiving a plurality of video shots; analyzing each frame in a video shot from the plurality of video shots, the analyzing comprising determining a saliency of each frame of the video shot, the saliency being a content attentiveness saliency providing a measurement of representative shot properties; determining an effective visual saliency based on the determined saliency, the effective visual saliency based on camera motion of the plurality of video shots and a human attention model of the video shot; selecting a key frame of the video shot based on the effective visual saliency of each frame of the video shot; extracting visual features from the key frame; performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features; and generating a hierarchical reconstruction based on the shot clustering, the hierarchical reconstruction enabling a skimming preview of the video.