\(\bullet\)_Position interpolation._ This method downscales the position indices within the original context window, to avoid out-of-distribution rotation angles during pre-training [240, 289]. To be more specific, this approach multiplies all position indices by a coefficient \(L/L^{\prime}\) (\(L<L^{\prime}\)), where \(L\) and \(L^{\prime}\) represent the original and target context window length, respectively. Experimental results [240] have shown that this method can extend the context window effectively and efficiently, compared to the above approach of direct model fine-tuning. However, it is worth noting that this technique may have an adverse impact on the model's performance when handling shorter texts[240, 290].