**Parameter 3** (Figure 10).: When dealing with models of significantly different sizes for LoRA finetuning, it's necessary to adjust the LoRA rank sizes. In [3], the authors primarily used a rank \(r^{\prime}=128\) update for the embedding layer and ranks \(r=8\) or \(16\) for the query/value matrices, with their base model being either GPT2-12-12 or GPT2-12-20.