Though both BERT and RoBERTa are recent and state of the art, the sentences to be checked for similarity before feeding into the network resulting in computational overhead. This can lead to scaling issues later on. To leverage state-of-the-art performance by BERT/RoBERTa but avoiding computational overhead, we leverage an extremely robust and more recent neural network architecture called Sentence-BERT (SBERT) [1]}.
