1. A system for determining a similarity of a first video to a second video, the system comprising: one or more processors; memory coupled to the one or more processors; an analysis component stored in the memory and operable on the one or more processors to: receive an image from the first video; divide the image into a plurality of sub-images, the plurality of sub-images including marginally arranged sub-images; determine a feature common to each of the plurality of sub-images; score the sub-images based on the common feature; create a binary representation of the image based on the scoring of the sub-images, one or more individual binary values of the binary representation representing rank relationships between individual ones of the marginally arranged sub-images compared to other individual ones of the marginally arranged sub-images; combine the binary representation of the image with another binary representation of another image from the first video to form a visual shingle; and evaluate a similarity of the first video to the second video based on a number of occurrences of the visual shingle in the first video and a number of occurrences of the visual shingle in the second video; and an output component stored in the memory and operable on the one or more processors to output results of the evaluation.