1. A video evaluation apparatus comprising: storing means for storing a reference characteristic which is a predetermined spatio-temporal frequency characteristic about a video; first video characteristic analyzing means for calculating a first video characteristic based on a spatio-temporal frequency characteristic of a target video consisting of a plurality of images; second video characteristic analyzing means for calculating a second video characteristic based on a spatio-temporal frequency characteristic of a frequency-component-restricted video obtained by restricting a subset of frequency components in target images; and video evaluation determining means for calculating an evaluated value of the input target video, based on a relative relation between a change amount of the second video characteristic calculated by the second video characteristic analyzing means, relative to the first video characteristic calculated by the first video characteristic analyzing means, and the reference characteristic stored in the storing means, wherein the spatio-temporal frequency characteristics can be sensed by human eyes.