* 1 Introduction
* 2 Pretraining
	* 2.1 Data Processing
	* 2.2 Tokenization
	* 2.3 Model Architecture
* 3 Finetuning
	* 3.1 Data Preprocessing
	* 3.2 Training Method
* 4 Infrastructure
* 5 Safety
* 6 Evaluations
	* 6.1 Base Model Performance
		* 6.1.1 Main Results
		* 6.1.2 Discussions
		* 6.1.3 In-Context Learning Study
	* 6.2 Chat Model Performance
		* 6.2.1 Automatic Evaluations
		* 6.2.2 Human Evaluations
* 7 Capability Extension
	* 7.1 Long Context Modeling
	* 7.2 Vision-Language
	* 7.3 Depth Upscaling
* 8 Final Discussions
* A Author List and Contributions