We adopted the classical two-alternative forced choice (2AFC) experimental paradigm. To evaluate video stability, pairs of videos were presented to the subject simultaneously, and the subject was instructed to pick the more stable video. Considering that a subject may not be familiar with what stability means, we collected a few examples from demo videos (a stable video and an unstable video) from previous video stylization studies [1]}, [2]}. To evaluate frame stylization quality, pairs of frames along with the corresponding style image were presented to the subject, and the subject was instructed to select the image based on the similarity of its style to the reference style image. The contents of videos or frames and the style images were controlled to be the same for comparing the performances of two different temporal losses.
