Moreover, as previous approaches restrict the power of the pre-trained models to representation extraction only [5, 6,<cite> 7,</cite> 8] , the proposed method is robust and can be fine-tuned easily on downstream tasks.