A wide range of open-source large language models is available for the backbone, spanning from \(70\) million parameter models like Pythia Biderman et al. (2023) to \(180\) billion parameter models like Falcon Almazrouei et al. (2023). In this work, we choose the Mistral 7B model, a \(7\) billion parameter open-source model that achieves high performance across benchmarks and tasks Jiang et al. (2023).