Figure 2: The pass@1 performance of main LLM models on the GSM8k benchmark, our model is currently ranked in the top five, slightly outperforming some close-source models such as ChatGPT-3.5\({}^{5}\), Claude Instant-1\({}^{6}\), PaLM 2 [44], and substantially surpassing all open-source models.