Both aspects underscore the imperative to refocus efforts on comprehensively exploring smaller, yet potent, language models (SLMs). These models on the one hand provide efficient solution to practical deployment, on the other hand, if trained with scalable strategies, they can potentially guide the development of future larger models.