Raffel et al. (2020) introduces a unified framework for converting all text-based language problems into text-to-text format. The aim is to explore the potential of transfer learning techniques for natural language processing. In contrast to the original transformer, a simplified version of layer normalization is used, where activations are rescaled without additional biases. After applying layer normalization, a residual skip connection (He et al., 2016) adds the input of each subcomponent to its output. Srivastava et al. (2014) is applied to the feed-forward network, the skip connections, the attentional weights, and the inputs and outputs of the entire stack. The T5 model has been widely used as a language model by many researchers, such as Hofstatter et al. (2023), Sachan et al. (2021), and Singh et al. (2021). Additionally, Chung et al. (2022) proposed instruction tuning as an approach to improve model performance. The study focused on three aspects: the number of scaling tasks, the size of the scaled model, and the fine-tuning of chain of thought data. The results showed that larger model sizes and more fine-tuning tasks significantly improved model performance. Additionally, the study found that chain of thought(CoT) significantly improves inference level. Wang et al. (2023) used this approach to tune T5 and apply it to the RALM architecture.