Footnote 1: The accuracy numbers are reported in the GPT-4 technical report (OpenAI, 2023b). GPT-4 models are continuously being improved. The latest GPT-4 Turbo (1106) API has increased accuracy to 94.8% on GSM8K and 64.5% on MATH. However, the LLaMA-2 7B model using the best of 256 generations still outperforms the latest GPT-4 models.