In informal experiments, it‚Äôs found that only inserting LN cannot achieve satisfactory adaptation results, and inspired by [11], we combine fine-tuning output layer with Full-LN/LRPD-LN based method in the following experiments.