In addition to the studies based on vanilla Transformer, there are a surge of Transformer variants with efficient attentions and other efficient architectures, aiming to alleviate high computational cost for modeling long texts. These studies have been extensively discussed in Section 4.2.1 and Section 4.2.2. Furthermore, context compression and prompting techniques (_e.g.,_ iterative reasoning [303]) have also been proven to be a viable strategy for handling long text tasks [304, 305, 306, 303], without the need of model adaption.