We introduce StableLM 2 1.6B, the first in a new generation of our language model series.
In this technical report, we present in detail the data and training procedure leading to the base and instruction-tuned versions of StableLM 2 1.6B.
The weights for both models are available via Hugging Face for anyone to download and use111https://huggingface.co/stabilityai/stablelm-2-1_6b222https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b.
The report contains thorough evaluations of these models, including zero- and few-shot benchmarks, multilingual benchmarks, and the MT benchmark focusing on multi-turn dialogues.
At the time of publishing this report, StableLM 2 1.6B was the state-of-the-art open model under 2B parameters by a significant margin.
Given its appealing small size, we also provide throughput measurements on a number of edge devices.
In addition, we open source several quantized checkpoints and provide their performance metrics compared to the original model.