Moreover, as previous approaches restrict the power of the pre-trained models to representation extraction only [5, <cite>6,</cite> 7, 8] , the proposed method is robust and can be fine-tuned easily on downstream tasks.