Paper review: SimCSE: Simple Contrastive Learning of Sentence Embeddings
Paper link: https://arxiv.org/pdf/2109.03127.pdf Conference: EMNLP 2021 Contents Summary SimCSE’s Contrastive Learning Alignment and uniformity Unsupervised SimCSE Unsupervised SimCSE — Dropout Mask Supervised SimCSE Connection to Anisotropy Experiment results My thoughts 1. Summary Various methods has been suggested to resolve the representation degeneration problem. …
Paper review: SimCSE: Simple Contrastive Learning of Sentence Embeddings Paper link: https://arxiv.org/pdf/2109.03127.pdf Conference: EMNLP 2021 Contents Summary SimCSE’s Contrastive Learning Alignment and uniformity Unsupervised SimCSE Unsupervised SimCSE — Dropout Mask Supervised SimCSE Connection to Anisotropy Experiment results My thoughts 1. Summary Various methods has been suggested to resolve the representation degeneration problem. … nlp
Paper review SimCSE Simple Contrastive Learning Sentence Embeddings Paper link httpsarxivorgpdf210903127pdf Conference EMNLP 2021 Contents Summary SimCSE’s Contrastive Learning Alignment uniformity Unsupervised SimCSE Unsupervised SimCSE — Dropout Mask Supervised SimCSE Connection Anisotropy Experiment result thought 1 Summary Various method suggested resolve representation degeneration problem … nlp