To best benefit the open source community, **phi-3-mini** is built upon a similar block structure as Llama-2 [TLI\({}^{+}\)23] and uses the same tokenizer with vocabulary size of 320641. This means that all packages developed for Llama-2 family of models can be directly adapted to **phi-3-mini**. The model uses 3072 hidden dimension, 32 heads and 32 layers. We trained using bfloat16 for a total of 3.3T tokens.