In this work, we propose a joint audio-video fingerprint Automatic Content Recognition (ACR) technology for media retrieval. The problem is focused on how to balance the query accuracy and the size of fingerprint, and how to allocate the bits of the fingerprint to video frames and audio frames to achieve the best query accuracy. By constructing a novel concept called Coverage, which is highly correlated to the query accuracy, we are able to form a rate-coverage model to translate the original problem into an optimization problem that can be resolved by dynamic programming. To the best of our knowledge, this is the first work that uses joint audio-video fingerprint ACR technology for media retrieval with a theoretical problem formulation. Experimental results indicate that compared to reference algorithms, the proposed method has up to 25 query accuracy improvement while using 60 overall bit-rates, and 25 bit-rate reduction while achieving 85 accuracy, and it significantly outperforms the solution with single audio or video source fingerprint.
Determining similarities among data objects is a core task of content-based multimedia retrieval systems. Approximating data object contents via flexible feature representations, such as feature signatures, multimedia retrieval systems frequently determine similarities among data objects by applying distance functions. In this paper, we compare major state-of-the-art similarity measures applicable to flexible feature signatures with respect to their qualities of effectiveness and efficiency. Furthermore, we study the behavior of the similarity measures by discussing their properties. Our findings can be used in guiding the development of content-based retrieval applications for numerous domains.