On the next page we report the results for **phi-3-mini** on standard open-source benchmarks measuring the model's reasoning ability (both common sense reasoning and logical reasoning). We compare to phi-2 [JBA\({}^{+}\)23], Mistral-7b-v0.1 [JSM\({}^{+}\)23], Mistral-8x7b [JSR\({}^{+}\)24], Gemma 7B [TMH\({}^{+}\)24], Llama-3-instruct-8b [AI23], and GPT-3.5. All the reported numbers are produced with the exact same pipeline to ensure that the numbers are comparable. These numbers might differ from other published numbers due to slightly different choices in the evaluation. As is now standard, we use few-shot prompts to evaluate the models, at temperature 0. The prompts and number of shots are part of a Microsoft internal tool to evaluate language models, and in particular we did no optimization to the pipeline for the **phi-3** models.3 The number of \(k\)-shot examples is listed per-benchmark. An example of a 2-shot prompt is described in Appendix A.