Cosine Similarity for 1 Trillion Pairs of Vectors
Introducing ChunkDot —  Success! I managed to find vector representations for my 1 million items… I just need to calculate the cosine similarity between all pairs to find the 20 most similar items per item. Then, from sklearn.metrics.pairwise import cosine_similarity, throw my 1 million vectorized items into it, and bam!
My computer explodes with…
Cosine Similarity for 1 Trillion Pairs of Vectors Introducing ChunkDot —  Success! I managed to find vector representations for my 1 million items… I just need to calculate the cosine similarity between all pairs to find the 20 most similar items per item. Then, from sklearn.metrics.pairwise import cosine_similarity, throw my 1 million vectorized items into it, and bam!
My computer explodes with… nlp
Cosine Similarity 1 Trillion Pairs Vectors Introducing ChunkDot — Success managed find vector representation 1 million items… need calculate cosine similarity pair find 20 similar item per item sklearnmetricspairwise import cosinesimilarity throw 1 million vectorized item bam computer explodes with… nlp