Nearest neighbor search is known as a challenging issue that has been studied for several decades. Recently, this issue becomes more and more imminent in viewing that the big data problem arises from various fields. In this paper, a scalable solution based on hill-climbing strategy with the support of k-nearest neighbor graph (kNN) is presented. Two major issues have been considered in the paper. Firstly, an efficient kNN graph construction method based on two means tree is presented. For the nearest neighbor search, an enhanced hill-climbing procedure is proposed, which sees considerable performance boost over original procedure. Furthermore, with the support of inverted indexing derived from residue vector quantization, our method achieves close to 100 recall with high speed efficiency in two state-of-the-art evaluation benchmarks. In addition, a comparative study on both the compressional and traditional nearest neighbor search methods is presented. We show that our method achieves the best trade-off between search quality, efficiency and memory complexity.
Hill-climbing strategy is adopted in our search scheme due to its simplicity and efficiency. Different from @cite_6 @cite_27 , the search procedure is directed by residue vector quantization (RVQ) @cite_18 . Firstly, the candidate vectors are quantized by RVQ. However, different from compressional methods, the quantized codes are used only to build inverted indexing. Candidate vectors sharing the same RVQ codes (indexing key) are organized into one inverted list. In comparison to @cite_27 , only 4 bytes are required to keep the index for one vector. When a query comes, the distance between the query and the RVQ codes are calculated, the candidates reside in the lists of top-ranked codes are taken as the seeds for hill-climbing procedure. The inverted indexing built from RVQ codes plays the similar role as k-d trees in @cite_27 , while requiring very small amount of memory.
@cite_27 @cite_18 @cite_6
2526367648 2119913432 2121456571
Advances in residual vector quantization (RVQ) are surveyed. Definitions of joint encoder optimality and joint decoder optimality are discussed. Design techniques for RVQs with large numbers of stages and generally different encoder and decoder codebooks are elaborated and extended. Fixed-rate RVQs, and variable-rate RVQs that employ entropy coding are examined. Predictive and finite state RVQs designed and integrated into neural-network based source coding structures are revisited. Successive approximation RVQs that achieve embedded and refinable coding are reviewed. A new type of successive approximation RVQ that varies the instantaneous block rate by using different numbers of stages on different blocks is introduced and applied to image waveforms, and a scalar version of the new residual quantizer is applied to image subbands in an embedded wavelet transform coding system. A new data structure for efficient similarity search in very large datasets of high-dimensional vectors is introduced. This structure called the inverted multi-index generalizes the inverted index idea by replacing the standard quantization within inverted indices with product quantization. For very similar retrieval complexity and pre-processing time, inverted multi-indices achieve a much denser subdivision of the search space compared to inverted indices, while retaining their memory efficiency. Our experiments with large datasets of SIFT and GIST vectors demonstrate that because of the denser subdivision, inverted multi-indices are able to return much shorter candidate lists with higher recall. Augmented with a suitable reranking procedure, multi-indices were able to significantly improve the speed of approximate nearest neighbor search on the dataset of 1 billion SIFT vectors compared to the best previously published systems, while achieving better recall and incurring only few percent of memory overhead. In multiple antenna wireless systems, beamforming is a simple technique for guarding against the negative effects of fading. Unfortunately, beamforming requires the transmitter to have knowledge of the forward-link channel which is often not available a priori. One way of overcoming this problem is to design the beamforming vector using a limited number of feedback bits sent from the receiver to the transmitter. In limited feedback beamforming, the beamforming vector is restricted to lie in a codebook that is known to both the transmitter and receiver. Random vector quantization (RVQ) is a simple approach to codebook design that generates the vectors independently from a uniform distribution on the complex unit sphere. This correspondence presents performance analysis results for RVQ limited feedback beamforming